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NYU Booklets 3D and 4 A 

Pxirpose - 

The NYU Booklets were designed to measure areas of pre- 
school achievement. Booklet 3D is designed to measure 
achievement in pre-math^ pre-science and linguistic concepts. 
Booklet 4a is designed to measure achievement in shape, 
numeral and Alphabet names. These concepts are taught in 
many preschool programs in the Head Start Planned Variations 
Study. 

Description 

Booklet 3D is composed of the following three subte.^ts: 
l.,Pre-math relational concepts. Seven items assess 
basic concepts of quantity and serial relation. Examples 
are "Point to "the boy-^ho iias all -^he balloons" and "Point^ 

y 

to the closed door. " 

2. Pre-^science relational concepts. Seven items assess 
the basic concepts of "dry", "young", "short"., "thin", "far 
away", "wide", and ''ol>J" . 

3, Linguistic concept of prepositions. Five items 

" / ^» 
assess the understanding of the prepositional phrases of 

physical relation: "over", "behind", "down", "away", and 

"against". 

Booklet 4A is com.posed of the following three subtests : 
1. Alphabet naones. Nine items assess the child's 
recognition of printed capital letters. 
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2. Numeral names. Six items assess the child's 
knowledge of nuiserals . 

3; Shape naines. Three items assess the child's 
recognition of shapes: heart, diamond and rectangle. 

Each item correct in each booklet is scored "1". 
The total maximuun score is 19 for Booklet. 3D and 18 for 
Booklet 4A. Sun^nary scores and a set of scores, obtained 
by considering the three subtests as criterion-referenced 
-measures, were us^d in the data analysis (see Smith, 1973> ^. 

Development .of Instrument 

The subtests of Booklets 3D and 4A are shortened ver-- 
sions of six Early Childhood Inventories which are being 
developed Tinder the joint directorship of A. Coller and J. 
Victor at the Institute for Developmental Studies at the 
New York University School of Education. The Early Child- 
hood Inventories have been developed to be easily administered 
easily scored, emd appropriate for disadvantaged children. 
At the present time there are 17 inventories available in 
experimental forms. In addition to the six being used in 
the HSPV Study there are inventories to measure body parts ' 
names r color naines, classroom objects' names, quantity 
matching, set matching, same and different relationships, 
lower Case alphabet letters, comparatives concepts and super- 
latives concepts ((foller and Victor, 1971) . Since these 
inventories are still in experimental stages, there is no 
technical information available. 
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Norms* 

There is nb original norming sample for the NYU 
Booklets since they were in experimental form before being 
adapted for use in the Head Start Planned Variation Study. 

Norms for raw scores are available for ^ the Fall 1970 
HSPV sample for Booklet 3D (Table 1 - 7) and for Booklet 
4A (Tcibles 8 - 14) • Norm tables based on three month age 
divisions (ten groupings from 42-44 months to 69-71 months) 
give the number of children, the mean score and the standard 
-deviation at each age level for the following groupings in 
the HSPV sample: total (3D - Table 1, 4A - Table 8), 
females (3D - Table 2 , 4A - Table 9), males (3D - Table 3, 
\ 4A - Table 10), children with no previous preschool exper- 
ience (3D - Table 4, 4A - Table 11) , children with previous 
preschool experience (3D - Table 5 , 4A • Table 12), black 
childreh (3D - Table 6 , 4A - Table 13), and white children' 
-) (3D - Table 7, 4A • Table 14) . The mean Booklet 3D score 

for the total Fall 1970 sample was 11. 849 (S.D. - 3.277, ^ 
^ N = 2161) , v/hile the mcian Booklet 4A score* was 5.645 
(S.D. =• 3.273, N = 2150). In general, scores on both 
booklets increase with age, are higher for white children 
than for black children, and are higher for children with 

.Oi, ^ 

^ previous preschool experience than for children with no 
previous preschool experience. 
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DISTRIBUTION OF NYU BOOKLET 3D SCORE S FOR ALL CHILDREN 

, ^ , J , 

IN THE FALL 1970 HSPV SA^IPLE-^ 



j Age (Months) 

V 


N 


2 

Mean Score 


, S.D. 


- 42-44 
45-47 
48-50 
51-5 3 
54-56 
57-59 
60-62 
63-65 
66-6 8 
69-71 


10' 
61 
207 
314 
355 
350 
274 
230 
182 
178 


8.700 
10.60 7 

9.957 
10.96 5 . ' 
11.487- 
11.860 
12,500 
12.730 
13. 15 9 
13. 433 


3.348 
3.413 
3.085 
, 3.204 
3.20 2 
3 .0 34 
.2'.99 4 • 
3.120 
2.^19 
3.270 


tot5\l 


2161 


11.849 


3.277 











1 ■ i 



* 

^Incl\i.des jail children not ijn Level I sites, Oraibi, 
'or Fresno, who had adequatelage information on sex, 
age/ race, and preschool expb^2:ience . 

2 . ■ 

^Maximum score =19 . • . 



TABLE 2 



DISTRIBUTION OF NYU BOOKLET 3D SCOEES FOR FEfALES 
IN THE FALL" 19 70 HSPV SAMPLE-"- 



. Age (Months). 


N : 


Mean Score 


S.D. 


. 42-4^ 


5 


7.000 


3.521 


45-47 


32 


10.969 


2.995°" 


48-50 ' 


102 


10.^92 


2.958 


51-53 


151 


11.040 


, 3.092 


54-56 


179 


.11.665 


, 3.232 


57-59 


162 


12.228 


2 . 85 5 


60-62 


140 


12.15 7 f ■■' 


2.824 


63-65 


116 


13.P43 


3.182 


66-6 8 


89 


13.39 3 


.2.807 


69-71 A 


86 


* 13.360 


2.965 




t 








1062 


11.994 


3.17,1 



^Includes all children ;not in Level I sites, Oraibi, 
'or Fresno/ v/ho had adequate age information on sex, 
age, ra'ce, and preschool experience, ■ ' . 

/^Maximum score = 19 ^ 



275 



ffABLB 3 



DISTRIBUTION OF NYU BOOKLET 3D SCOfeS FOR ^{ALES 



IN THE FALL 1970 HSPV SAMPLE 



Age (Months) 


N 


Mean Seore 2 


» S.D. ■ 


. 42-44 






■5- 


10.400 


2.059 


45-47 






29 


10.207 


• 3 . 782 


4 8-50 






105 


9.533 


3.147 


51-53 






16-3 


10.896 . ^ 


, 3. 302 


54-56 






176 


11.307 


3.162 


57-59 






188 


° f 11. 543 


3.146^ 


60-62 






134 


12.85 8 


. 3.122 


6 3-65 






114 


12.412 


3.02 3- 


' 56^68 






93 


12.935 


2. 812 


6^-71. 






92 


13.500 


: 3.531 


TOT?^L 






1099 


0 

11,709 


' 

3.370 










m 





ERIC 



^jlncludGS all children -not in^ Level I sites, Oraibi 
'or Fresno, v:h'o had adequate age information on sex, 
aige, race, and preschool experience. 

I^aximum score = 19. • 
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— TABLE 4 



» - DI STRIBUTION O F NYU BOOKLET 3D SCORES' FOR ALL CHILDREN WITH 
NO f>REVIOUS PRESCHOOL EXPElRl^NCE I,N THE FALL 19 70 HSPV SAMPLE 



Age .(Months) 



N 



Mean- Score 



S:D. 



1 



42-44 
45-47 
48-50 
51-53 
54-56 
57-5'9 
60-62 
63-65 
56-6 8 
69-71 



TOT^^L , 



10 
55 , 
' 185 
2'85 
V29-3' 
29.0 
20 4, 
162 
135 
130 



1749 



-8.700 , 
10 .527 
'9 .§08 ; ■ 
10^979.' 

11. -3^2 
1^.707 , 
12.299 
12.660 
i2, 978 

12. 977* ' 



11.638 




3.26 3. '. 



^^Ji^^2l^(^es all children ;nQf in Level I sites, Oraibi, 
Fresno, who had adequate age information .on sex, 
age, race, and preschool experience. 

ERJC ^^sximum score =19. • 



• fABLE 5 



DISTRIBUTION OF NYU BOOKLET 3D SCORES FOR ALL CHILDPER WITH 

-*— — '■ * ■■ ■ : - — 

PREVIOUS RRESCHOOL EXPERIENCE IN THE FALL 1970 HSPV SAMPLE^ 



Age ' (Months ) 



42-44 
45-47 
48-50 
'51-53 
54-56 
57-59' 
60-62 
63-65. 
56-68 
69-71 



N 



Mean . Score ' 





. . . i 


1 


11.000 


15' 


9.933 


16 


11.063 


42 


11.738 


44 


.5 12.477, 


5.9 


12 . 864 


' &6 


; 13.015 


42 ^ 


13. 833 


45 


14.756 



12 . 855 



a- 




3.20-7 
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''"IncludGs all children ;riot in' Level I ,sites,, Oraibi^ 
'pr^Fresnp^ who* had adequate age information on sex, " 



age , 



race, and preschool experience. 



2m 



Maximum score = . 19 . 



y 



TABLE 6 • 



DISTRIBUTION OF NYU BOOKLET 3D SCORES FOR BLACK CHILDREN 
■ IN THE FALL 19 70 HSPV SAMPLE 



Age (Months )' 


N 


Mpan Score ^ 
J- ^ 


S.D. 


















. 42-44 


' 3' • 


■ ' 12.000 


0.816 


. 45-47 


38 


10.737 


3.160 . 


4 8-50 


127 • 


9.929 


^ 2.927' 


51-53 


171 


10.585 


3.149 


54-56 


188- 


2 1.277-. 


3.274 . 


. 57-59 . 


■ 189 


11.646 


3 . 15 7 


60-62 


10 7 


, 12.019 


2.845 


63-65- 


10 7 


12. 822 


2.912 


56-6 8 


, -84 


12.786 


2.695 


•69-71 


105 . 


12.848 


3.411 


TOT^^L 


r 

1119 


11.543 


3.234 









. V ■ . • - : ■ ■ ^ 

\ • ' , 

Includes all children ;not m Level I sites, Oraibi, 
'or Fresno, who had adequate age information on sex, 
age, race, and preschool experience. 



"•Maximum score" = 19 • 
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• TABLE 7 

DISTRIBUTION OF NYU BOOKLET 3D SCORES FOR TTHITE CHILDREN 

_. J ; . 

1 

IN THE FALL 1970 HSPV gAflPLE 



Age ^-Months) 


N 


2 

Mean Score 


S.D.. - 


. 42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
56-68 




6 

22 

69 
114 
124 
116 
110 

86 

61 ' 


7.500 
10 . 818 
10.116 
11.491 
11.734. 
12.224 
13.173 
13.523 
.14.344 


- \ ■■' 

3.202 
3.284 
3.264 
. 3.264 
3.228 
2.983 
3.048 
2.823 
2. 82 8. 


69-71 




51 


14.961 


2.737 


T0T5VL 


V 


759 


12.403 


|. 366 



•""Includes all children ^not in LeyeX I sites^ Orai.i>-iT- 

'or Fresno, who had adaauate age information dn sex, 

age, race, and preschool experience. 

O 2 ' 
ERs^C Ilaximum score =19. 
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TABLE 8 



DISTRIBUTION OF HYU BOOKLET 4A SCORES FOR ALL CHILDREN 
IN THE FALL 1970 HSPV SAl^.PLE''" 



Age (Months) 



42-44 
45-47 
*48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
56-6B 
69-71 



TOTAL 



N 



10 
61 
205 
309 
35 3 
348 
276 
230 

181 
177 



2150 



Mean Score 



3. 
4, 
4. 
5, 
5. 
5. 
6. 
5, 
6. 
6. 



200 
869 
805 
10 7 
742 
80 7 
062 
530. 

127 
452 



5.645 



S.D, 



561 
670 
568 
60 3 
341 
291 
70 8 
275 
3.367 
3.764 



3.273 



0_ 



•'■Includes all children -not in Level I sites, Oraibi, 
'or Fresno, viho had adoc3uate age information ©n sex, 
age, race, and preschool experience. 

^Maximum score =18. 
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TABLE 9 

DISTRIBUTION OF NYU BOOKLET 4A SCORES FOR FEMALES 
IN THE FALL 1970 HSPV SAMPLE""" 



Age (Months) 


N 


2 

Mean Score 


S.D. 


* 

^4fc — 4 H 


5 


3.200 


3.187 ■ 


45-47 


32 


4.688 


1.895 


48-50 


101 


5.188 


2.379 


51-53 


149 


5.114 


, 2.445 


54-56 


179 


5.492 


2.966 


57-59 


151 


5.851 


3-221 


60-62 


141 


6.000 


3.696 


63-65 


116 


5.440 


3.249 


66-68 


89 


6.416 


3.496 


69-71 


86 


6.535 


^3.669 


• 

TOT?^L 


1059 


5.653 

• 


f. 156 



•"•Includes all children -not-. in Level I sites ^ Oraibi, 
'or Fresno, who had adeqTaate age information on sex, 
age, race, and preschool expedience, 

^McixiinxiiTi score - 18* 
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TABLE 10 

DISTRIBUTION OF NYU BOOKLET 4A SCORES FOR MALES 
IN THE FALL 1970 HSPV SAMPLE-"- 



Age (Months,) 


N 


2 

Mean Score 


S.D. 


- 42-44 


5 


3. 200 


1.720 


45-47 


29 


5.060 '\ 


■3. 311 


48-50 


104 


4.4 33 ' 


2.688 


51-53 


160 


5.100 


, 2.741 


54-56 


174 


6.000 


3.669 


57-59 


187 


5.770 


3. 350 


60-62 


135 


6.126 


3.719 


63-65 


114 


5.623 


3.299 


06-68 


92 


5.848 


3.213 


69-71 


91 


6.374 


3.851 


TOT^L 


1091 


5.636 


3. 383 



■**Includes all children 'not in Level I sites, Oraibi, 
or Fresno, who had adoauate age information on sex, 
age, race^ and preschool experience, 

o 

O tlaxiiuuin score =18. 

ERIC 
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TABLE 11 

DISTRIBUTION OF NYU BOOKL E T 4A SCOP.ES FOR ALL CHILDREN WITH 
KO PREVIOUS PRESCHOOL EXPERIENCE IN THE FALL 19 70 HSPV SAMPLE 



Age (Months) 


N 


Mean Score ^ 


S.D. 


- 42-44 


- 

10 


3.200 


2.561 


45-47 


55 


4. 727 


2.260 


48-50 


183 


4.716 


'2.615 


51-53 


2 82 


5. 110 


( 2 • 2 6 


54-56 


291 


■ 5.478 


2.992 


57-59 


238 


5.691 


3.223 


60-62 


206 


^ 5.854 


3.419 


63-65 


152 


5.352 


3.202 


56-68 


134 


5.948 


3.175 


69-71 


129 


6.333 


3.665 


TOT^L 


1740 


5.469 


3.083 











"Includes all children not in Level I sites, Oraibi, 
or Fresno, who had adequate aae information on sex, 
age, race, and preschool e:q>erience. 
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1ABLE 12 

PI^TRISUTIOl-7 OF NYU. BOOKLET 4A SCORES FOR 'ALL CHILDRHM I'JITH 
PREMIOUS PRESCHOOL' EXPERIENCE ' IN THE FALL 19 70 HSPV SAf'PLE-'- 







2 




Age (Months) 


N 


Mean Score 


S.D. 


. 42-44 








45-47 


1 


5.000 




48-50 


15 


5.533 


2.276 


51-53 


14 


5.643 


, 3.772 


54-56 


42 


6.095 


4.017 


57-59 


4^ 


5.386 


2.35 7- . 


60-62 


59 


6.220 


4 .423 


63-65 


66 


6.015 


3.436 


56-68 


42 


6.619 


3.909 


69-71 


45 


6.644 

c 


3.854 


TOT?^L 


328 


6.101 


3.704 



FRir 



^Includes all children ^not in Level I sites, Oraibi, 
or Fresno, who had adecjuate age information on sex, 
age, race, and preschool experience, 

9^ 2, 



"Maximum score = 18. 
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TABLE 13 



DISTRIBUTION OF IIYU BOOKLET 4A SCORES FOR BLACK 
CHILDREN IK THE FALL 19 70 KSPV SA-MPLE"*- 



Age (Months) 


N 


Mean Score 


. S.D. 


42-44 


3 


4.333 


2.055 : 


45-47 


38 


5 .158 


O A A 

2 . 4 J4 


48-50 


• 126 ■ 


4 . 849 


2.520 


51-53 


"170- 


4.882 


, 2.459 


54-56 


188.^- 


5.564 


3.336 


57-59 


189 


5.497 


3.230 . 


60-62 


10 8 


5.259 


3. 348 


63-65 


107 


5.187 


3.383 


56-68 


84 


5.512 


3.39 3 


69-71 


10 4 


5.962 


3. 838 


TOTAL 




5.319 


3.165 



ERIC 



■•'•IncludGS all. children -not in Level I sites, Oraibi 

or Fresno^ who had adequate age information on sex, 

age, race,, and preschool experience. 

*> 

^Maximum score = 18. 
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TABLE 14 

DISTRIBUTION OF NYU BOOKLET 4.A SCORES FOR VTHITE 
CHILDREN IN THE FALL 1970 HSPV SAJIPLE-"- 



Age (Months) 


N 


Mean Score ^ 


S.D. 


42-44 
45-47 
48-50 - 
51-53 
54-56 
57-59 
60-62 
63-65 
56-68 
• 69-71 


b 
22 
68 
112 
124 
115 
110 
86 
60 
51 


2 . U 0 U 

4.591 
, 4.515 
' 5.402 
5. 847 
6.522 
.6.745 
6.256 
6.950 
7.29 4 


2 . 0 o2 
. 2.871 
2.361 

, 2.846 
3. 391 
3.569 
4.069 
3.275 

' 3.481 
3.696 


tot5\l 

t 


754 


6.060 


3.478 



"Includes all children 'not in Level I sites, Oraibi, 
or Fresno, who had ad3auate age iriformation on sex, 
age, race, and preschool experience. 

Maximuin score =18. 
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Reliability 

Booklet 3D and 4A reliability estimates {KR-20's) for 
the total sample and subsamples of the fall 1969 and fall 
1970 HSPV samples are listed in Tables 15--18.In general^ the 
reliability is Low (in for both booklets. The 

range of the fifty- five coefficients calculated for the 
fall 1969 Booklet 3D sample (Table 15) was from .341 (n = 
17) for northern older blacks with no previous preschool 
experience to .778 (n = 178) for northern children with 
previous preschool experience. Only 24% of all the coefficients 
were below .60. For the fall 1970 Booklet 3D sample (Table 

16) the coefficients ranged from .361 (n = 44) for southern 
young blacks with previous preschool experience to .687 

(n = 932) for white children. Only 7% of all the estimates 
were below .60. For the fall 1969 Booklet 4A sample (Table 

17) the coefficients ranged from .039 (n = 16) for northern 
older white children with previous preschool experience to 
.80 3 {n=16) for nothern older blacks with no previous pre- 
school. 35% of these coefficients were below ,60. Coefficients 
for the fall 1970 Booklet 4A sample (Table I3)ranged from 

.391 (n=i53) for southern young blacks with no previous pre- 
school to .839 (n ~ 40) for northern young blacks wi'th pre- 
vious preschool. Only 15% of these KR-20's were below .60.' 

Item Characteristics 

A factor analysis of Booklets 30 anrl 4a toaether 
demonstrated that the tests should remain separate for 
analyses. A- factor analysis of Booklet 3D alone revealed there 
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'table 15 

KR-20 RELIABILITIES FOR FALL 1969 HSPV BOOKLET 3D SCORES 





n 


me an^ 


S .D. 


KR-20 


1 

Total 


1692 


12.698 


3. .321 


.694 


Black 


1176 


12.411 


3.323' 


.686 


White 


516 


13. 353 


3.228 


.699 


Mr 1 e 


821 


12 557 


3 309 




Female 


865 


12.822 


3.331 


.702 


3 

Young 


80 8 


11.345 


3.055 


.595 


Old 


884 


13.933 


3.065 


.683 


Previous 


542 


13.908 


3.176 


.709 


Preschool 










No Previous 


1150 


12.128 


3.236. 


.658 


res ch ooi — 










North 


649 


12.057 


3.484 


- .710. 


South 


1043 


13.097 


3.153 


.671 j 



Sample includes .all blacks and whites between 35 and 77 
months at October 1, 1969 , v/ho had a fall test score and 
data on the previous preschool experience question. 

Maximum score is 19. 

'Young is less than 60 mon-chs; old is greater than 59 month 



289 



TABLE 16 

KR-20 RELIABILITIES FOR FALL 1970 HSPV BOOKLET 3D SCORES 





i n 


mean"^ i 


S. D. 


KR-20 


Total-"- 


1 

2581 


11. 845 


3. 25 3 


.657 


Black 


1309 


11.548. 


3. 202 


.641 


White 


932 


, 12.401 


3. 327 


.687 


i*lcl J. c 


1 T 7 9 


11 inn 

11 m / U U 


Q Q /I "7 


C "J A 

, . b /4 


Female 


1249 


11. 999 


3. 143 


. 635 


Young^ 


1143 


10.907 


3.202 


• ,.629 


Old 


1437 


12.592 


3.097 


. 637 


Previous 
Preschool 


474 


12.705 


3. 187 


.661 


No Previous 
Preschool 
• 


2100 


11. 645 


3.239 


. 650 


North 


1495 


11,6 83 


3.163 


.634 


South 


1086 


12.067 


3.360 


.684 



Sample includes all children who were not in a Level I 
site or Oraibi between 32 and 79 months at October 1, 
1970. 

Note: 98% of the children were between 41 and 71 months. 

Spanish-speaking children are included in the total 
sample. 

Maximum score is 19. 



^ ^Young is less than 57 months; old is greater than 56 month 
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TABLE '17 



KR-20 RELIABILITIES FOR FALL 196 9 HSPV BOOKLET 4A SCORES 





n 


2 

mean 


S.D.,^ 


, < — 

KR-20 


Total-"- 


1676 


6.039 


3„. 279 




Black 


1162 • 


5.998 


J. 290 


.677 


^ White- 


514 


6. 130 


3.255 


.680 


Male 


807 


5. 886 


.J. 231 


.668 


Female 


863 


6.172 


3. 322 


.684 . 


3 

Young ^ 


803 


5 . 277 


2. 552 


. 475 


014 


' 873 


6.740 


3.692 


.742 


Previous 
Preschool 


538 

I 


6.846 c 


3.587 


.723 


No Previous 
Preschool 


1138 

! 


5.657 


3.051 


.6 31 


North 


1 

642 


5.947 


3.159 


.651 


South 


! 

1 1034 

1 

1 


6. 096 


3. 351 


.691 



Sample includes all blacks and whites between 35 and 77 
months at October 1, 1969, who had .a .fall test score and 
data on the previous preschool experience question. 

^Maximum s t;orte is 1 8 . - \. " r • " ' 



.9 '3 



:nf/->""^Young is less than 60 months; old is greater than 59 months 
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J 



TABLE X8 

KR-20 RELIABILITIES FOR FAI.L 1970 HSPV BOOKLET 4A SCORES 



} 1 

1 

1 
! 


n 


2 <. 
mean ; 


S.D. 1 


KR-20 ( 


Total-'- 


2568 


5. eel* 


3.238 


.. 686 


Black V 




D • J4 / 




. 0 / u 


White 


927 


6.042 


3.448 


.725 


Male 


1324 


5. 603 


3.287 


.696 


Female 


12 4.4 


5.723 


3.18& ' 
V 


.674 


Young^ 


1132 


5.^74 


2.913 ■• 


. 618 


Old 


1435 


5.955 


3 . 44 5 


. /ly 




472 


6.413 


3.820 


.772 


Preschool 










No Previous 


2089 


5.483 


_ 3. 062 


.649 


Preschool 










North 


1484 


5. 830 


7-3^S 


.676 


South 


10 84 


5.430 


3.265 


.697 



Sample includes all children who were i^iot in .a Level I site 
or Oraibi between 32 and 79 months at October 1, 19 70. 

Note: 98% of the children were between 41 and 71 months. 
Spanish-speaking children are. included in the' 

^ total sample. 

«. * 

? • . ; r^ 

^Maximum score xs 18. • , 



ER^C "^Yoxing is less than 57 months;- old is greater than' 56 months. 
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is only one stcible / interpretable factor. 

Close investigation of the frequency distributions of 
scores of.' Booklet' 3D for four subsamples of children witn 
previous preschool" experience (young whites, old v;hites, 
young blacks, old blacks) for fall 1969 and spring 19 70 
reveals that there is a ceiling effect in the spring. In 
all these groups at both times scores were negatively skewed. 
Ceiling effects are most prominent in the spring with the 
older children, especially the older -white children with 
previous pteschool experience (see Tables 19 and 20) . In 
spring 1970, 78% of the older white children were at the three 
top scores (score 17 — 27%\- score 18 — 22%; score 19 — 29%). 

Investigation of the frequency distributions of scores 
of Booklet 4A for^ the same four subsamples for fall 1969 
and spring 19 70 reveals that there are no floor or ceiling 
effects. In all of the ..groups the scoir^s were positively 
skewed in the fall and more normally distributed in 'the 
spring. 

t> * • 

Correlations with Other Tests ^ ^ . .'c^' 

Correlations of Booklets 3b and 4A, with the CPSGS, the . 
MI Subtests and the 64-item PSI are listed in Table 21 for 
the total fall 19 70 HSPV sample and several subsamplea (blacks., 
whp.tes , • young, old, previous preschool experience, no pre- 
vi|pus preschool ^experience) . ' Correlations with- the PSI 
are estimates of the concurrent validity of the NYU Booklets. 
In every case, the correlations of Booklet with the .64- , 
item PSI are higher than the correlations, of Booklet 4A with 
^^^Qhe PSI. This is probably explained by the •greater similarity 
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TABLE 19 



(Cont) 



Young Blacks • 
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Total 
Score 



Number of 
Children 



% of 
children 



Cum. % of 
children 



0 
1 
2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 
12 
18 
19 



0 
0 
0 
0 
0 
0 
0 

1 

2 
2 
12 
4 
5. 
4' 
13 
13 
10 
9 
4 
1 



80 



0.0 




0.0 


0.0 




0.0 


1).0 




.0.0 


0.0 




0.0 


0.0 




0.0 


0.0 




0.0 


0.0 




•0.0 


0.01 • 




0.01 


0.02 




0.04 


6.02 




0.06 


0.15 




0.21 


0.05 




0.26 


0.06 




0". 32 


0.05 




0.37 


0.16 




0.54 


0.16 




0.70 


0.13 




0.82 


0.11 




0.94 


0.05 




0.99 


0.01 




1.00 



if 
ft 
if 

* .) 
if 

if if 
if if if 
if if if 

irkififififififififififif 
icifififif 
****** 
*****- 

******** *•* * * * * 

************** 

*********** 

********** 

***** 

** 
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TABLE 20 



DIST-RIBUTldk OF SPRING 1970 BOOKLET 3D SCORES 



FOR OLD I"?HITES AND OLD BLACKS 



WITH PREVIOUS PRESCHOOL EXPERIENCE 



Old '/Thites 



' Total 


j Number of 


% of 


Cumj % of. 




Score 


' Children 


Children 


Children 




0 


0 


0.0 


,0.0 


* 


1 


0 


0.0 


0.0 


* 


2 


0 


0.0 


io.o 


* 


3 


0 


0.0 


0.0 


* 


4 


0 


0.0 


0.0 


* 


5 


0 


0.0 


0.0 


* 


6 


0 


0.0 


, 0.0 


* 


7 


0 


0.0 


; 0.0 


* 


"8 




0.0 


; 0.0 


* 


! 9 


0 


U . 0 


: 0.0 




10 


0 


0.0 


0.0 




11 


0 


0.0 


0.0 


* 


. 12 


0 


0.0 . 


0.0 


* 


' 13 


1 


0.02 


0.02 


** 


14 


0 


0.0 


0.02 


* 




4 


0.10 


0.12 


ititlfkit 


:6 


4 


0.10 


0.22 




17 


11 


0.27 


0,49 




18 


9 


0.22 


0.71 


*********i«^ 


'19 


12 


0.29 


1.00 


************* 


- 


41 






3 



Old is greater than 59 months. 
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TABLE 20 
(Cont) 



Old Blacks 



Total 
Score 



Nuitiber of 
Children 



% of 
Children 




Cum. % of 

Children 



0. 

0, 
0, 
0. 
0 
0 
0 
0 
0 
0 
0 
0 
0 
0 



0 
0 
0 
0 
0 
0 
0 

02 
02 
04 
05 
10 
,14 
, 25 
0. 40 
0.49 
0. 63 
0.78 
0.93 
1.00 



* 
* 
* 
* 
* 
* 
* 

** * 
* 

*** 
** 

***** 
***** 

*********** 

*************** 

******* ** 

************** 

*************** 

*************** 

******* 
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TABLE 21 

CORRELATIONS OF BOOKLET 3D AND - ^ 
4 A SCORES WITH THE CPSCS, MI SUBTESTS r THE 64 -ITEM 



PSI^-*- AND THE STANFORD-BINET IQ AKD Mfi/ FOR FALL 1970 HSPV DATA 



NYU 
3D 


PSI 
64-item 


CPSCS 


Ml2 
walk 


MI 
draw 


MI 
truck 


iq4 


MA 


Total • 
Sample 
NYU 
4A 


.429 

(2125) 


.467 

(2117) 


-240 

(2045) 


.142 

(1072> 


-142 
(1077) 


;io€ 

(106!5) 


.365 

(749) 


,435 

(750) 


NYU 
3D 




.696 

(2127) ' 


.297 

(2057) 


-.275 
(1073) 


.298 
(1078) 


.136 
(1065) 


,427 

(753) 


,640 

(754) 


Blacks 


















NYU 
4A 


.480 

(759) 


.513 
(752) 


-269 
(723) 


.LSO 
(440) 


.148 

(440) 


.030 
(440) 


.442 

(294) 


.534 

(294) 


NYU 
3D 




* .710 
(756) 


.303 

(728) 


.303 

(440) 


,297 
(440) 


.120 
(440J ' 


.434 

(296) 


.69e 

(296) 


Whites 


















NYU 
4A 


.467 
(1082) 


.492 
(1076) 


.214 
(1043) 


-150 
(545) 


.126 

(546) 


.121 
(542) 


.394 

(370) 


.446 
(371) 


NYU 
3D 




• 699 
(1054) 


.270 

(1052) 


.278 
(547) 


.326 
(548) 


.153 

(543) 


.436 

(374) 


.658 

(375) 


YouLiig ^ 


















NYU 
4A 


.407 

(1012) 


• 451 

(1007). 


.222 
(979) , 


.075 
(408) 


.046 
(412) - 


.160 
(412) 


.256 

(313) 


-317 
(313) 


NYU 
3D 




• 652 
(1017) 


• 314 

(990) 


- .253 
(408) 


.200 

(412) 


.205 
(412) 


.453 
(316) 


.528 
(316) 



Sample size for each correlation is in parentheses. Children included 
were not in Level I sites , Oraibi, or Fresno; between 43 and 74 months; 
and in school for the full year. 

MI scores are log transformations of the "slow" times; MI scores were 
used only if the child had passed two out of four practice items. 

^Under 58 months. 



Pinneau IQ calculations used. 



TABLE _21 
(Cont) 





NYU 
3D 


PSI 
64 


CPSCS 


MI 
walk 


'mi 

draw 


MI 
truck 


IQ 






















•NYU 
4A 


.426 
(1113) 


.469 

(1110) 


.235 

(1066) 


,160 
(664) 


.167 

(665) 


.085 
(653) 


.470 

(436) 


.476 
(437) 


• NYU 
-3D 




.676 
(1110) 


.245 
(1067) 


.259 

C665) 


.303 

(666) 


.113 

(653) 


.541 

(437) 


.641 

(438) 


Previous 
Preschool 


















NYU 
4A 


. 443 

(409) 


.485 
(408) 


.191 

. (39a) 


.147 

(203) 


.094 
(202) 


.082 

(198) 


.441 

(147) 


.451 

(147) 


N'.-U 
31) 




.717 
(410) 


' .295 
(400) 


■ .37e- 
(203) 


.330 

(202) 


< .155 
(198) 


. 389 

(147) 


.638 

(147) 


No Prev:.ous 
Preschool 


















NYU 
4A 


.417 
(1716) 


.452 
(1709) 


• 244 

(1647) 


. 140 

(869) 


.142 
(875) 


.124 

(967) 


.338 

(602) 


.413 

(607) 


NYU 
3D 




.684 
(1717) 


.285 
(1657) 


.249 
(870) 


.280 
(876) 


.141 

(867) 


.422 

(606) 


.624 

(607) 



'Over 58 months. 
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of items between the PSI and Booklet 3D. There are very 
few items of recognizing letters^ numbers and shapes (con- 
tents of Booklet 4A) in the PSI. If the correlations are 
corrected for unreliability"'', the estimated correlation 
between the true score components of the 64-item PSI and 
Booklet 3D is .90 (.70 t \/( .66) (.92) ) . In general, correla- 
tions between the NYU Booklets and other tests are higher for 
whites, older children, and children with previous preschool 
experience. 

Remarks 

Neither Booklet 3D or 4A is an adequate achievement 
estimate alone since they both have low internal reliability 
and the 3D has definite floor and ceiling effects. Inter- 
pretations of suznmary scores are sometimes difficult to make. 
This is less true of Booklet 3D since its true correlation 
with the 64-item PSI is very high, indicating that they are 
measuring the same cognitive domain. 

These booklets are best used as a set of criterion- 
referenced measures. Using this concept, the percentages 
of children in various sites and models who obtain either a 
perfect score or only one item incorrect on each subtest and 
who fail to get more than one item correct on each subtest 
are reported. ;\ 

■ '• 0 

1 ^1*2 

Using formula ' where r-^.j is the correlation betwee 

.tests and tj^^ t2 are estimates of test reliabilitv. 
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Parent Information Form 

Purpose 

The Parent Information Forms were designed to obtain a 
variety of background information about the parents and 
children in the Head Start Planned Variation sample. 
The data can be used as independent and dependent variables 
in the analysis* This information enables investigators to 
assess what a child brings with him from his background to 
the Efead Start experience and what changes^ if any, the Head 
Start experience have on a child and his family. 

^ Description 

A Parent Information Form (PIF) was administered to 
mothers in the HSPV sample who were given the Eight-Block Sort 
Task. The content of the Parent Information Form changed 
from year to yeir, as questions were added, deleted and 
modified. In general, the PIF included questions about 
the following areas: ' 

1. Demographic. These questions served primarily as 
a check on- the data gathered on the Classroom Information 
Form. This information was included only in Fall 1971. 

2. Non-demographic family background. The parents 
were asked for such information as how often they read to 
their children, how often they go on trips, and what the 
child does at home. The information tapped by these 

9^"^^stions can be interpreted as measures of the background 
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which the child brings to Head Starts and thus as independent 
variables in the analysi-s. Changes can also be interpreted 
as possible effects of Head Start on parents^ and thus as 
dependent variables. ^ 

3. Parent and child attitudes. On some forms of the 
PIF parents were asked a series of attitude questions de- 
signed to measure the parents' sense of control over the 
environment. On all forms parents were asked about their 
own and their child's feelings toward the Head Start program. 
Like the . non-demographic family background measures, these 
can be interpreted both as dependent and independent variables 

4, Parent participation. The parents were asked about 
their own involvement in the Head Start programs. Community 
Action Program (CAP), membership, volunteer work/ etc. 
Since parent involvement is an important goal of the Head 
Start program, these questions measure an important desired 
outcome. Parent involvement may also be a contributing factor 
to child success. 

Reliability 

A test-retest i::eliability study was done on the rather 
short form of the PIF which was given in the fall of 1971. 
The study is reported in Appendix F. This form did not 
include any questions on parental sense of control. Nor 
did it include, since it was given in the fall^ questions 
about participation or feelings about Head Start. Thus 
nothing can be said about the reliability of these items. 



\ 
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The findings using a very small sample indicate that the 
PIF is a reliable instrument for gathering demographic 
data of the sort on the short form of Fall 1971, Questions 
of a simple yes/no format are especially reliable. Because 
of the lov7 response rates for many questions and the findings 
of moderate consistency on the educational aspirations and 
e:55)ectancies questions, it is doubtful that adequate attitude 
d^ata can be collected on such a form. 

Remarks 

The data on the non-attitudinal , simple format questions 
used in the PIF appears to have adequate reliability r based 
on a very small sample. Rel^iability estimates for these 
items using a larger sample and for attitude and participation 
items using any sample need to be determined before such a 
form is used in other studies. 
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Peabody Picture Vocabulary T^t 



Purpose 

The Peabody Picture Vocabulary Test (PPVT) is de- 
signed to measure a child's verbal intelligence by 
measuring his receptive vocabulary — the number of words 
which h6 knows when he hears them. Vocabulary is a 
major component of general intelligence measures. Vocab- 
ulary subparts of both the Stanf ord-Binet and the WPPSI 
correlate in the low .70* s with their respective total 
"intelligence" scores (McNemar, 1942; Wechsler, 1967), 

Description 

The PPVT is an untimed individual test consisting 
of a booklet with three practice items and 150 test 
plates each with four numbered pictures. The version 
used in the HSPV Study is Form A, modified by SRI and 
ETS to include pictures of blacks. For each item the 
stimulus word (a noun or verb form) is presented 
orally and the child is required to indicate the pic- 
ture corresponding to the wptd^ either, by pointing or 
by giving the number of the appropriate picture. 
Items increase in difficulty and are presented to a 
child until six errors are made out of eight consecutive 
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responses or the test is completed. A complete list of . 
the words appears in Table 1. < . 

The maximum number of words given was 100 in Fal]^ 
1971- and 150 in Spring 1972. In the fall all children 
began the test at item 1 and continued until the ceil-*' 
ing was reached or 100 words had been given. In the 
spring every child began at item 25 and a basal level 
was established: 

1, If the child got items 25 through 32 correct. 

2. If the child missed any item from 25 to 32, 
the tester gave the items backwards from 
item 24 until 

a. the child got eight correct in a row, or 

b. the child went through items 24 to 1 
without getting eight correct in a row. 

In the first case, the test was continued from item 32 
until the ceiling or end of the test was reached. In 
the* second case, the test was continued from the first 
item missed by the child until the ceiling or the end 
of the test was reached or t'he test was discontinued 
if the child had already missed six out of eight items. 

Each item was scored as correct^ incorrect, child 
refused or indeterminate. This is a "tailored test, "'mean- 
ing that there is not a fixed number of items givei;i to each 
child. The. test is also Guttman-scaled; in other words , it 
is assumed a child will get all items correct below any 
specific item on the test.' * . 
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TABLE 1 

WORDS INCLUDED IN THE PE^BODY PICTURE VOCABULARY TEST 



1 • 




26. 


teacher 


51. 


submarine 


*> 

2 • 


cow 


27. 


building 


52. 


thermos 


J • 


baby 


28. 


arrow 


53. 


projector • 


A 

H m 




29. 


kangaroo 


54. 


group 


5. 


ball 


30. 


accident 


55. 


cackling 


o • 


DiOClC 


31. 


nest 


56. 


transportation 


/ • 


c xown 


32. 


caboose 


57. 


counter 


8. 


key 


33. 


envelope 


58. 


ceremony 


y • 


can 


34. 


picking 


5^ 


pod 


10 • 


cnicKen 


35. 


badge 


60. 


bronco 




D lowing 


36. 


goggles 


61. 


directing 


12. 


fan 


37. 


peacock 


62. 


funnel 


13 • 


dxgging 


38: 


queen 


63. 


delight 






39. 


coach 


64. 


lecturer 


15 . 


eaten xng 


40. 


whip 


65. 


cominunication 


lo • 


drum 


41.' 


net 


66. 


.archer 


17 , 


leat 


42. 


freckle 


• 67. 


stadium 


18. 


tying 


43. 


eagle 


68. 


excavate 


1 Q 


^ Y\ ^ O 


44. 


twist 


69. 


assaulting 




• 

Vka 4- 

Oat 


45. 


. shining 


70. 


stunt 


21. 


bee 


46 . 


dial 


71. 


meringue 


22. 


bush ' . 


47. 


yawning 


72. 


appliance 


23. 


pouring 


48. 


bumble 


73. 


chemist 


24'. 


pewi-nq 


49. 


" signal 


74. 


arctic 

destruction^ 


25. 


wiener 


50^ 


capsule 


75. 







TABLE 1 


(CON* T) 


76. 




101. 


* 

graduated 


11 . 


.coast . . 


102. 


hieroglyphic 


78. 


hoisting 


103. 


orate 


79. 


» wailing 


104. 


cascade 


80. 


coil 


105. 


illumination 


81. 


kayak 


106. 


nape 


82. 


sentry 


107. 


genealogist 


83. 


furrow 


108. • 


embossed 


.84. 


beam 


109 . 


mercantile 


85. 


fr agment 


.110. 


encumbered 


86. 


hovering 


111. 


entice 


87. 


bereavement 


112. 


concentric 


88. 


crag 


113. 


vitreous 


89. 


tantrum 


114. 


sibling 


90. 


submerge 


115. 


machete 


91. 


descend 


116. 


waif 


92. 


hassock 


117. 


cornice 


93. 


canine 


118 . 


timorous 


94. 


probing 


119\^ 


fettered 


95. 


angling 


120. 


tartan 


96. 


appraising 


121. 


sulky 


97. 


confining 


122. 


obelisk 


98. 


, precipitation 


123 . 


eclipse 


: 99. 


gable 


• 124. 


entomology 


O 100. 


amphibian 


125. 


bumptious 
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126. 


dormer 


127 . 


coniferous 


128. 


consternation 


129 . 


obese 


130 . 


gauntlet 


131. 


inclement 


132 . 


cupola 


133. 


obliterate | 

1 


134. 


burnishing 


135. 


bovine 


136 . 


eminence 


137 . 


legume 


138. 


senile 


139 . 


deleterious 


140 . 


raze 


141. 


ambulation 


142. 


cravat 


143. 


impale 


144. 


marsupial 


145. 


predatory 


146. 


incertitude 


147. 


imbibe 


148. 


homunculus 


149. 


cryptogam 


150 . 


pensile 
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Development of Instrument 

In 1959 Lloyd M. Dunn developed the PPVT in two 
parallel Forms A and B as a measure of receptive Vbcabu- 
' lary for ages two-and-one-half to eighteen. In selecting 
the final stimulus words for the test Dunn had several 
groups of .subjects of all ages selectively sort from 
an original pile of 2,055 line drawings of illustip"able 
nouns and verbs (Euros, 1965) , Sii?ce its creation 
the PPVT has been widely used in studies with children, 
especially mentally retarded and handicapped children 
(see references in Buros, 1965; 1972)* Several investi- 

/■ , V 

gators have use<^ the original PPVT version with disadvantaged 
preschoolers (Costello & Ali, 1971; Datta, *1967; DiLorenzo 
& Brady, 1968; Milgram & Ozer, 1967; Rieber & Womack, 1968; 
Shipman et al, , 1971). The first 75 items of the standard 
Dimn test were used in the first year of the ETS Longitudinal 
Study (Shipman, , 19 72). • For the second year of the study, a 
modified version of 50 'items which contained redraftings of a 

• number of human pictures to include blacks and adults in a 
^ variety of roles / was used. This modified 60 item version 

• was extended to all 150 pictures by Shipman and Tanaka in 
19-71 for use in the 1971-72 HSPV study and Follow Through 
evaluation. 

O 
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St.andardization 

The original PPVT standardization sample was based 
entirely on 4,012 white children in and around Nashville , 
Tennessee. Children ranging in number from 92 to 
354 and representing 19 different age levels from 2,5 
to 18 years were tested on both forms. Only children 
under nine were given the test individually. The 
standard scores (PPVT IQs) were derived by assigning an 
IQ of 100 (S.D. = 15) to the mean raw score for each 
distribution of subjects arranged in six month age 
intervals. There is a problem in using these norms with 
younger children since two children with the same raw 
score one month apart will get widely discrepant IQ 
scores. For example, a 44-month-old child with a raw 
score of 2 8 would be assigned an IQ of 89 while a child 
one month older with the same raw score would be assigned 
an IQ of 76 (a 13 point difference) . Because of the 
inconsistencies in the norm tcJDles, DiLorenzo and Brady 
(1968, p, 247) concluded that "the use of PPVT IQ data 
in the evaluation of preschool programs could produce 
invalid results and thus lead to spurious conclusions 
regarding program effectiveness." In several previous 
studies with disadvantaged preschool populations (Datta, 
1967; DiLorenzo &^&ra''dy, 1968; Milgram & Ozer, 1967; 




'bwer than the normalization sample. 



PPVT scores have been substantially 
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Norms (mean, S.D,, percentiles) for the raw scores of 
the ETS Head Start Longitudinal sample are available for 
children in Year 1 (in three month age intervals from 42-59 
months) and for children in Year 2 (in three month age inter- 
vals from 51-69 months) ,(see Shipman, 1972). The mean for 
the total sample in Year 1 was 26.3 (S.D. = 12.85, N = 1198); 
the mean for the total sample in Year 2 was 41.6 (S.D. = 9.75, 
N = 1309) . 

Norms for raw scores of the HSPV version of the PPVT 
are available in Tables 1 - 8.. Based on 15 three month age 
intervals from 36-38 months to 78-80 months, these tablets give 
the., number of children, the mean score and the standard devia- 
tion at each age level for the following groupings of the HSPV 
sample: total sample (Table 1), males (Table 2), females 
(Table 3) , children with previous preschool experience (Table 4) , 
children with no previous preschool experience (Table 5) , black 
children (Table 6) , white children (Table 7) and Mexican- 
American children (Table 8) . The mean score for the HSPV 
sample was 31.525 (S.D. = 13.258, N = 2996). A developmental 
age trend can be evidenced in all of the norm tables. 
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TABLE 1 



DISTRIBUTION OF PPVT SCORES FOR ALL CHILDREN 
IN THE FALL 19 71 HSPV SAMPLE-"- 

— >, 



Age (Months) , 


N 


2 

Mean Score 


S.D. 


36-38 


5 


20.400 


13.185 


39-41 


4 


23.500 


3. 354 


42-44 


22 


13 . 864 


9 . 251 


45-47 


76 


21.697 


10 . 885 


48-50 


263 


24.711 


10 .930 


51-53 


474 


26 .633 


11. 841 


54-56 


4 76 


29.626 


11.938 


57-59 


468 


31.630 


13.021 


60-62 


381 


34.554 


13. 360 


63-65 


■ 259 


35 .216 


12.611 


66-68 


261 


36.659 


12. 346 


69-71 


211 


39 .336 


12.205 


72-74 


89 


42 .000 


12.437 


75-77 


4 


36 .750 


2 3.424 


78-80 


3 


33.000 


9.416 


TOTAL 


299 6 


31. 525 


13.25 8 



Includes all children with adequate age information 
not in Level I sites • 



r-aximum score = 150. 
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TABLE 2 



DISTRIBUTION OF PPVT SCORES FOR MALES 
IN THE FALL 19 71 HSPV SAMPLE"'- 



Age (Months) 


N 


2 

Mean Score 


S.D. 


36-38 








39-41 


1 


22.000 . 




42-44 


8 


18.250 


5.449 


45-47 


47 


21.447 


10.536 


48-50 


130 


25. 815 


11. 291 


51-53 


252 


27.433 


12. 429 


54-56 


235 


30.055 


12.310 


57-59 


239 


31. 594 


13.455 


60-62 


201 


35.552 


13.421 


63-65 


120 


35.725 


12.930 


66-68 


138 


37. 391 


12.790 


69-71 


98 


41.061 


12.034 


72-74 


47 


42.936 


12. 542 


75-77 


2 


60.000 


2.000 


78-80 


2 


35.000 


11.000 


TOTAL 


1520 


32.161 


13.620 



Includes all children with adequate age information 
not in Level I sites . 

^Maximum score = 150. 
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TABLE 3 



DISTRIBUTION OF PPVT SCORES FOR FEMALES ' 
IN THE FALL 19 71 HSPV SAMPLE""- 



Age (Months) 


N 


2 

Mean Score 


S.D. 


36-38 


5 


20 .400 


13.185 


39-41 


3 


24.000 


3.742 


42^44 


14 


20.786 


10.732 


4 5-47 




^ ^ . X u o 


X X . n X J 


48-50 


133 


23.632 


10... 45 3 


51-53 


222 


25.725 


11.066 


54-56 


241 


29 .207 


11.549 


57-59 


. 229 , 


31.668 


12.551 


60-62 


■ 180 . 


33.439 


13.202 


63-65 


139 


34.777 


12. 313 


66-68 


123 


35.837 


11.775 


69-71- 


113 


37.841 


12. 155 


72-74 


42 


40 .952 


12. 234 


75-77 


2 


13.500 


3.500 


78-80 


1 


29.000 




TOTAL 


1476 


30.870 


12. 843 



Includes all children with 
not in Level I sites. 

Maximum score = 150. 



adequate age information 



TABLE 4 



DISTRIBUTION OF PPVT. SCORES FOR ALL CHILDREN WITH 
PREVIOUS PRESCHOOL EXPERIENCE IN THE FALL 19 71 HSPV SAMPLE 



Age (Months) 


N 


Mean Score^ 


S.D. 


36-38 
39-41 












42-44 


o 
z 


TO n nn 
JZ . U UU 


"7 AAA 

/ . 00 0 


45-4'7 


8 


35.000 


13.257 


48-50 


35 


25.857 


11. 736 


51-53 


66 


30.318 


11.455 


54-56 


58 


29.345 


11. 897 


57-59 


76 


33.882 


12.190 


60-62 


118 


36.610 


11. 854 


63-65 


S8 


34.939 


■ 11.758 


66-68 


94 


37.160 


10 .522 


69-71 


96 


39.135 


11.656 


72-74 


•38 


40.474 


10.351 


75-77 


2 


60 .000 


2.000 


78-80 


2 


37.500 


8.500 


TOTAL 


693 


• 34.999 


12.216 



Includes all children with adequate age information 
not in Level I sites/ 

l^aximum score =150. 
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' TABLE 5 ■ 

DISTRIBUTION OF PPVT SCORES FOR ALL CHILDREN WITH NO 
PREVIOUS PRESCHOOL EXPERIENCE IN THE FALL 19 71 HSPV SAMPLE^ 



Age (Months) 


IN 


2 

Mean Score 


S. D . 


36-38 


5 


20 .400 


13.185 


39-41 


4 


23.500 


3.354 


42-44 


19 


18. 316 


8.639 


45-47 


67 


20 .060 


9.457 


48-50 


222 


\ 24.595 


10.868 


51-53 


391 


26.097 . 


11.900 


54-56 


404 


29 .921 


11.931 


57-59 


379 


31.15 8 


13.097 


60-62 


253 


33.648 


13.972 


63-65 


153 


36 .275 


12.683 


66-68 


161 


'36 .901 


12. 729 


69-71 


112 


40 .036 


12.154 


72-74 


51 


43.137 


13.677 


75-77 


2 


13. 500 


3.500 


78-80 


1 


24.000 




TOTAL 


2224 


30.660 


13.381 



Includes all children with adequate age information 
not in Level I sites. 

^raximum score = 150. 
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■ TABLE 6 



DISTRIBUTION OF PPVT SCORES FOR BLACK CHILDREN 
IN THE FALL 19 71 HSPV SAMPLE-"" 





IN 






36-38 


5 


20 .400 


13.185 


39-41 


1 


23. 000 




42-44 


14 


20 .571 


8.650 


45-47 




1 Q Q c: T 


o • z z ± 


48-50 


142 


21.542 


9.462 


51-53 


' 213 


23.005 


9.432 


54-56 


20 7 


25.324 


10.061 


57-59 


19 4 


27.918 


11.129 


60-62 


143 


29.063 


10 .945 


63-65 


111 


31. 369 


10 .265 


66-68 


107 


33.523 


10 .066 


69-71 


107 


35.916 


10.652 


72-74 


35 


34.914 


10.283 


75-77 


2 


13.500 


3.500 


78-80 , 


1 


24.000 




TOTAL 


1325 


27. 34 3 


11.211 



Includes all children with adequate age information 
not in Level I sites. 

"^Maximum score = 150." 
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TABLE 7 

DISTRIBUTION OF PPVT SCORES FOR WHITE CHILDREN 



IN THE FALL 19 71 HSPV SAMPLE 





I 


Age (Months) 


N 


Mean Score 


S.D. 


36-38 

39-41 

42-44 

45-47 

48-50 

51-53 

54-56 

57-59 

60-62 

63-65 ' 

66-68 

69-71 ■ 

72-74 

75-77 

78-80 








3 
■ 8 
33 
93 
183 
20 5 
188 
160 
95 
100 
81 
52 
2 
2 


23.667 
18. 625 

.23.970 
29.903 
32.290 
34.415 

• 36.920 
,40.506 
40.516 
41.500 
45.963 
47, 231 
60 .000 
37.500 


3. 859 
10 .099 
13.254 
10.751 
12.114 
11.984 
12.656 
12.462 
10.719 
11.236 

9.735 
10 . 321 

2.000 

8.500 


TOTAL 


1205 


36.972 • 

•> 


12.970 



Includes all childrei; with cdequate age information 
not in Level I sites. 



318 



TABLE 8 



DISTRIBUTION OF PPVT SCORES FOR MEXICAN- AMERICAN 
CHILDREN IN THE FALL 1971 HSPV SAMPLE""" 



Age (Months) 



N 



Mean Sc6re2 



S.D, 



36- 


38 


39- 


41 


42- 


44 


45- 


47 


48- 


50 


51- 


53 


54- 


56 


57- 


59 


60- 


62 


63- 


65 


66- 


68 


69- 


71 


72- 


74 


75- 


77 


78- 


80 



TOTAL 



22 
68 
5 3 
71 
69 
51 
51 
19 



404 



29.629 



27.500 


10. 352 


24.044 


11. 314 


27.868 


11.646 


29.296 


13.580 


32.246 


14.057 


33.098 


16.236 


33.431 


15.281 


29.211 


15. 182 



13,978 



1 , * 

Includes all children with adequate age information 

not in Level I sites, 
2 

I'aximum score' = 150, 
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Reliability ^ 

In general the reliability estimates for ,the PPVT are 
q,uite good. Dunn (1965) reports tliat the parallel forms 
reliability estimate with children between three and six is 
about .72. The internal reliability estimates {Alpha coeffi- 
cients) computed for the ETS Longitudinal study were .96 in 
Year 1 for the 70 item original version and .91 in Year 2 for 
the 60 item revised version (Shipman, 1972), Since the Year 1 
version was cut-off at 70 items and the Year 2 version had 
only 60 items, these estimates are probably inflated. 

Cos telle and Ali (1971) report a test-retest (two ^ 
week interval) coefficient of .77 between PPVT raw scores 
for 36 Iglack preschoolers (ages 4-1 to 5-0) . Milgram and 
Ozer (1967) found that the test-retest coefficient after ^ ^ 

four weeks was .69 for the PPVT MA's of 65 Head Start children 
(ages 4 1/2 to 6). The test-retept coefficient ^after 10 
months (from ages 3-1 to 3-11) was ,80 for PPVT MA's of 51 
* disac^v|tntaged preschoolers. The .69 coefficient of stability 
(correlation af form A administered in Year 1 and Year 2) for 
the PPVT was the highest of any in the ETS' Longi^dinal Study 
tesl? battery (Shipman, 1972). 

No internal consistency estimates were calculated for the 
HSPV s'kmple since , according to Stanley (1971), these estimates 
ate inappropriate . for a "tailored test" like the PPVT. A 
"tailored test'' is one where diere is not a fixed number of 
items' given to each child; instead, the test is "tailored" 
jgl^^o ^,j^he child* s level and needs. 



' Validity 

f 

Congruent or concurrent V-alidity estimates include 
comparisons with intelligence, language and achievement 
tests. Predictive vaJidity estimates include comparisons 
with future school success, Zn general, there are many 
more concurrent validity estimates available for the PPVT 
most of^ these are correlations with intelligence measures 

. Comparisons with the Stanf ord-Binet ■ Dunn (1965) 
reports that PPVT scores correlate .83 with SB IQ scores 
and ,64 with WPSSI scores. Several studies with disad- 
vantaged preschoolers have used both the Stanf ord-Binet 
and the PPVT* 'Even though the two tests are highly 
correlated, the PPVT IQ scores found in the^se studies 
have been consistently lower than the SB IQ's. -Using 
, a predominantly (85%) disadvantaged preschool sample 
(n =563) in seven New York communities, DiLorenzo and 
Brady (1968) found that PPVT IQ's were consistently 
about nine points lower thaa the SB mean IQ's, T^ese 
.differences, ranging in magnitude fjom 6.33 to 12,32, 
existed for every lO-point interval on th6 SB IQ scale 
from 50 to 130, The difference for the entire sample 
v/as 8.83 (SB mean IQ ^ 93.68; PPVT IQ = 84.85). The 
•correlation between the PPVT and SB was .79. DiLorenzo 
and Brady attributed th6 discrepancies between the two 
tests to- the inadeHjuate standardization norms. 

Milgram and Ozer (1967) found that the PPVT MA 
scores of two disadvantaged populations were consistently 

ERIC . * 
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lower than the SB MA's. For exajnple^ the SB- MTi of 65 
Head Start ^children (CA = 5-6) enrolled in a summer 
program* was 4-8 in June, compared with PPVT MA scores 
of 3-6 in June and 4-0 in August. The -authors felt 
that the PPVT scores were susceptible to a decelerating 
trend while SB scores were not. - The correlation between 
the SB IQ and the PPVT IQ at age 5 was .65 for 51 pre-- 
schoolers. Milgram and Ozer concluded that the PPVT 
is more susceptible to environmental impoverishment than 
the SB. 

In a study of 36 black preschoolers (ages 4-1 to 

5-0) Costello and Ali (1971) found that the PPVT raw 

score correlated .43 with the SB MA and .28 with the 

SB IQ. They hypothesized that the lower PPVT scores we^-e 
t 

attributable to either environmental variables or to 
examiner and situation variables. 

Finally, Bruinicks and Lucker (1970) found that the 
SB IQ calculated at the beginning of the first grade 
was a better predictor of the reading subtest of the 
Metropolitan Achievement Test (correlation at end of 
first grade = .32; correlation at the end of fourth 
grade = .60) than was the PPVT IQ (correlation at the end 
of first grade = .18; correlation at the end of fourth 
grade ' = .45). The correlation betv;een the two test IQ's 
for 36 lower class first grade children was .71. 
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Correlations with the PS I, Datta found that 
correlations of the ppVT with the original PSI v/ere high 
for a sample of 956 Head Stait children in 72 centers. 
Correlations of the PpVT faw score with PSI were .73 
for the total, .69 for age 4, .62 for age 5, and .80 
for age s/ (Datta, 196 7). ' 

In the ETS Longitudinal StudY,^..-Ship (1972) 
found that the highest .cotrel^ of the PPVT v7ith^~~ano"tRe 

test in the,.js^at;£ery W .58 with the 64-item PSI in 
^.Yeafr ,,1 ■*'^nd_ . 66 with the 64-item PSI in Year 2. 

In the third year of the HSPV Study, th.e highest 
correlation between the PPVT and another test in the 
battery was .665 for the 32-item PSI (See Table 9) . 

Correlations with the ITPA , Using a samp?.e of lower 
class Australian children, Teasdale (1969) found that 
the PPVT raw scores correlated .45 with the Verbal Ex- 
pression Subtest and .74 with the total ITPA score. 
Costello and Alv.4^r§^i) found a correlation of .28 
with the Verbal Expression Subtest. 

> " In the third ye.ar of the HSPV study, the correla- 
tion between the PPVT and the ITPA-Verbal Expression 
Subtest was .487 (See Table 9) . 

Correlations with the MI . In the ETS Longi- 
tudinal Study, the PPVT and the average 
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slow time of the Drawing and Walking subtests of the MI 
correlated .36 in Year 1 and .34 in Year 2 (Shipman, 1972). 

In the HSPV Study, the PPVT correlated .174 with the 
slow time of the MI Truck subtest (See Table 9). 

Correlations with the Eight Block Sort Task . In 
the ETS Longitudinal Study, the PPVT and total success 
score from the Eight-Block Sort Task correlated .39 in 
Year 1 and .53 in Year 2 (Shipman, 1972). 

In the HSPV study the PPVT correlated .439 with the 
total success score, .445 with the reason success score, 
and .304 with the placement success score (see Table 9). 

Other Correlations . Other PPVT correlations of 
interest from the ETS Longitudinal Study were those with 
the TAMA General Knowledge Test (.52 in Year 1; .63 in 
Year 2), with the Children's Auditory Discrimination 
Inventory: Nonsense Words (.52 in Year 1; .47 in Year 2), • 
with the Matching Familiar Figures: mean errors per 
valid item (-.45 in Year 1; -.50 in Year 2) and with the 
Seguin Form Board: Log fastest time for correct place- 
ment (■";40 in Year 1; -.46 in Year 2). 

Correlations with the PPVT and tests in the Fall 1971 
HSPV battery can be found in Table 9. Correlations over .40 
that have not already been cited are .413 (WR?\T-Copying Marks), 
. 537 (WHAT --Recognizing Letters), . 407 (WRAT-Reading Numbers), 
.475 (ETS Enumeration Total) and .492 (ETS Enumeration: 
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Counting Subtest) . 
Remarks 

The PPVT may be susceptible to practice effects and to 
unintended gestural or verbal hinting. by the examiner • 
This could introduce systematic biases which have not fully 
been examined in previous analyses. 

There are some problems about how to record changes 
in children's answers. The test manual says that when a 
child changes his choice, his last response should be 
recorded. Tt is possible that sometimes this change would 
be missed if a child pointed to a different picture while 
the tester was recording his first response.. This 
problem may produce systematic effects on both the 
reliability and validity of test scores, especially 
those with young children. 

Some items have a low probability of occurring in the 
natural environments of the children being tested. For 
instance, "weiner" is a label few children know. "Capsule" 
is most probably known in relationship to space rather than 
as a synonym for a pill. It is hard to know if such items 
lower everyone's score equally, or introduce systematic biases. 

Another area which needs to be further explored is the 
effect of switching betv;een nouns and verb forms throughout 
the test. • John and Goldstein (1964) found that black preschoolers 
had more trouble v;ith verb forms than noun forms of the original 
PPVT. Jeruchimowicz, Costello and Bagur (1971) found that 
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lower SES black preschoolers had a significantly higher 
proportion of errors on the action words (verbs) than the 
object words (nouns) of the PPVT, while middle SES black 
preschooler? showed no difference between verb and noun 
errors. It is also unclear what effects , result from omitting 
articles before nouns (i.e. , "Point to cat" rather than 
"point to the cat" or "point to a cat") . Articles were 
apparently eliminated to preserve symmetry of presentation 
for nouns and verbs. 

There may be a confounding of a child ' s increased 

attention span and increased vocabulary knowledge. This 
is further complicated in the fall data since all children 
start at the beginning rather than at an appropriate floor 

/ 

for him (as is done in the spring) . Greater variation 

in the number of items presented to each child is . / 

paralleled by greater differences in the demand on the 

child's attention span. Thus it would be hard to know 

if an improved score between two times reflected either 

an increase in receptive vocabulary or an increase in 

attention, neither, or both. 

Some of the above mentioned problems have been 
eliminated in the Modified Peabody Picture Vocabulary 
Test used by Ali and Costello (1971), The modified 
version consists of 70 items randomized for difficulty 
level:' specified stimulus instructions . and controlled 
schedules of reinforcement. Both the test-retest 
coefficic'nt and overall scores of black preschool 
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children were higher. for the modified version than the 
standard version of the PPVT. Further use and develop- 
ment of this modified version as v/ell as the E'XS short 
(60 item) modified version, is encouraged in future studies 
with preschoolers. 

Even though the PPVT has correlated fairly high with 
other intelligence and language measures cind has loaded 
highest on the "g" factor (general information — processing 
ability) in factor analyses of the ETS Longitudinal data 
(Shipman, 1971)/ it is recommended that it be used only as 
a measure of receptive vocabulary at this time. As Costello 
and Ali state : "While Form A of the Peabody could be used 
as first approximation in a continuing assessment program, 
scores cannot be considered alone for either intellectual or 
language evaluation' (1971, p. 755)." 
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Preschool Inventory 



Purpose 



The Preschool Inventory (PSI) 

. .was developed to give a measure of achievement in 
areas regarded as necessary for success in school. 
The Inventory is by no means culture free; in fact, 
one aim in its development v;as to provide educators 
with an instrument that would permit them to highlight 
the degree of disadvantage which a child from a de- 
prived background has at the time of entering school 
so that any observed deficits might be reduced or 
eliminated. Another goal was to develop an instru- 
ment that was sensitive to experience and could thus 
be used to demonstrate changes associated with educa- 
tional intervention. " (Cooperative Tests and Services, 

1970, p. 4.) 



Description 



Two versions of the PSI have been used in the HSPV Study. 
A 64-itein version (Revised Edition - 1970) was used in the 
first two years of the study. The 64 items include 21 on 
general knowledge, two on listening and work meanings, ten 
on listening and comprehension, four on writing and form 
copying, 24 on quantitative concepts, and three on speaking 
and labeling. In the manual published by Cooperative Tests 
and Services (1970) the items are divided into four main 
areas: Personal-Social Responsiveness (18 items) , Vocabulary 
(12 items) , Concept Activation-Numerical (15. items) , and 
Concept Activation-Sensory (19 items) . Most (60%) of the items 
require a verbal response from the child while the rest require 
him to follow directions such as ^'Point to the middle checker'* 
or "Color the triangle orange." 
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Only 32 items , all of which were in the Revised Edition- 
1970, were used in the third year of the HSPV Study with the 
Hertzig-Birch coding. Representative item examples include: 

1. Pointing to and naming body parts. 

2 . Prepositional concepts such as "on" , "behind" and 
"under". 

3. General knowledge such as "What is your first name?" 
and "What does a dentist do?" 

4. Numerical concepts such as "middle", "last", and 
"more" . 

5. Copying forms. 

6.. Recognizing colors. 

7. Motoric, reproductions such as "how a ferris wheel 
goes". 

Tne total PSI score for either version was defined as 
the total number of correct items. Separate analyses were 
done in the third year on the Hertzig-Birch codes. {See 
Hertzig-Birch section of this report for a complete explanatioxi 
Developmenr of Instrument 

The Preschool Inventory was originally constructed by 
B. Caldwell in the summer of 1965 to provide Proje/Ct Head 
Start with a practical measure or preschool- achievement. The 
test was intended to measure educational achievement for 
three to six year olds on skills traditionally Expected of 
middle-class kindergarten children. It was designed as a 
practical measure, more a criterion-reference classroom 
test to be used by teachers for diagnostic purposes than 
a test of psychometric intelligence of generalized cognitive 
ability. In addition, since the instrument was intended for 



use in the field, there was a concern that it require 
minimal training or special expertise to administer, and 
simple equipment (Cooperative Tests and Services, 1970) . 

Caldwell was responsible for an initial list of l€x 
questions, from which 85 were selected on the basis of a 
preliminary study and clinical item-analysis. The ^original 
list of questions was designed to measure performance in 
seven basic areas: 

1. Basic information and vocabulary. 

2. Number concepts and ordination. 

3. Concepts cf size, shape, motion and color. 

'4, Concepts of time, object class and social functions. 

5. Visual-motor performance. 

6. Following instructions. 

7. Independence and self-help. ■ y 

In the statistical analysis which led to the formulation of . 

the original 85-item test, a principal components factor 

analysis revealed that the 16.1 original questions involved 

four factors: concept activation (numerical and sensory), 

independent action, personal-social responsiveness, and 

associative voccibulary. It was decided to remove altogether 

the questions contributing to the "independent action" factor ^ 

and to weigh the "concept activation" factor doubly in the 

'a ■ - 

final 85~item test since it clearly accounted for the great-, 
est number of shared variance. In the 85-item test there 
also was a preference for questions highly correlated. with 
total test score, questions which varied in difficulty, and 
questions which were interesting to the children- taking the 
test (Caldwell, 1967; Cooperative Tests and Services, 1970) 
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Since the original formulation of the test, the inventory 
has been reduced in length: first in 1968-69 v/hen it was 'cut 
to 64 items (Revised Edition) ania then again in 1970-71 when 
the HSPV 32-item version and a Follow Through 29-item version 
were created. Each of the revisions involved eliminating some 
of the original 85 items vrithout adding new ones to the test. 
The 64-item version was also used in the 1968-69 Head Start 
national evaluation (Research Triangle, 1972) , and in the 
first ^two years of the ETS longitudinal study (Shipman, 1972). 
The 29-item version was used in a ].971 Follow Through pilot 
study (Emrick, 1972), The three items of the 32-item PSI 
dropped in the 29-item vef^sion are "What is your first^name" 
and "tolor the triangle orange" (counts as 2 items) . The 
32-item version is also being used in the Home Start study 

'to- . ' 

(Hi/Scope, 1973) . 

* 

Standardization 

The original standardization of the 6 4-item PSI is based on 
the responses of ^1531 children tested in fall 1969 in over 15^0 
Head Start classes throughout the United States. This sample 
includes only children tested in English. Some regional 
data, based on 107 to 248 subjects per region per age levels 
*are available. Percentile ranks for each age group and 
some of the regions are given in the 'manual (Cooperative 
Tests and Services, 1970). The number of children, mean 
scores and standard deviations for each of the age groups 
are summarized in Table 1, 
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o 

The Research Triangle Institute (1972) reports the scores 
on the 64~itein PSI for the 1968-69" Head Start national evalua- 
tion sample. Mean. scores of a subsample of 1162 children 
ranging in age from 2-7 to 6--0 years were slightly above 
those of the original standardization sample* 

The 64-item PSI scores (mean and S.D.) for Year 1 and 
Year 2 of the ETS Longitudinal Study are presented in Table 
2 {Shipman, et ul . , 1971; Shipman, 1972). The mean score 
for the year i sample (42-59 months) was 27.9 (S.E. = 11.9, 
N = 1974) ; tJie meai? score for the year 2 sample (31-69 months)" 
was 38.1 (S.D. = 12.3, N = 1311). In both years girls, who had 
a mean score of 29.1 (S.D. = 11.8) in Year 1 and a mean score 
of 40.0 (S.D. = 11*7) in Year 2 , obtained significantly higher 
scores than boys, who had a mean score of 26.8 (S.D. = 11.9) 
in Year 1 and a mean score of 36.5 (S,D. = 12,6) in Year 2. 

PSI (64-item) normative data for the Fall 1970 liSPV sample 
is reported in Tables 3-9. Kcrir. tables based on three month 
age divisions (ten groupings from 42-44 months to 69-71 months) 
give the number of children, the mean score and the standard 

deviations at each age level for the following groupings in— ^ 

the HSPV sample: total (Table 3) , children with previous pre- 
school experience (Table 4) , children with no previous pre- 
school experience (Table 5) , black children (Table 6) , white 
children (Table 7) , females (Table 8) , and males (Table 9) . 
The mean score for the total sample (N 2134) was 35.188 
(S^D. ^ 12.216). Children with previous preschool experience 



TABLE 2 

DISTRIBUTION OF 64-ITEM PSI SCORES FOR THE 
ETS HEAD START' LONGITUDINAL SAMPLE^ 
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Year 1 



Age Group 


N uir.be r 


9 1 

- Mean Score ^ 


/ S.D. 


3-6 to 3-8 


,89 




■ / 22.3 


./ 11.4 

/ 


3-9 to 3-11 


31 7 




/ 25.0 


j- 10.9 

r 

1'" 11.5 


4-0 to 4-2 


348 




/ 26.4 


4-3 to 4-5 


392 




^ 29.0 


11.6 


4-6 to 4-8 


270 


/ 

i 


32.1 


12.0 


4-9 to 4-11 " 


58 




35.3 /" 


12 . 6 


TOTAL 


1974 


\ 


^ ' 1 

27.9 1 


11 . 9 




■ 




Age Group 


^ Number '\ 


Mean Scgxe*"' 


S.D. 


4-3 to 4-5 
4-6 to 4-8 


82 

^,^,.^^*:^;69 


\; 


\ ■ 3 5 . "8 ;/ 


11.2 
12.3 


4-9,itC>"'?-il 


306 




\ / 


12.0 


■'' ' 5^b~To^ • 


351 . 






11.7 


■5-3 to 5-5 


'* 247 






13.2 


.4:^6_^ 5-8 


16 




\ 1 

\ 42.1 / ■■■ ■ 


10.4 


TOTAL 


""""""l^Tl---^- 


. _\ 38.1- . / 


12.3 



ERIC 



■'■ Reported in Shipman, 1972. 
2 MaxiiTium score = 64. 
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had a higher mean (n = 407, mean = 40. 4, S.D. = 11,7) than 
children with no previous preschool experience (n = 1727, 
mean = 34,0, S.D. = 12.0) (Tables 4 and 5). While children 
had a higher mean score (n = 759, mean = 37.5, S.D. = 12.8) 
than the black children (n = 1122, mean =33.7, S.D. = 11.6) 
(Tabids ..6 and 7) . Unlike the scores reported in the ETS 
Longitudinal Study by Shipm.an (1972) , the mean scores for 
males and females were within' one pvoirxt of each other 
(Tables 8 and 9) . 

Norms for the 32-item PSI for the Fall 1971 HSi V sample 
are -available in Tables 10-17. Based on 15 three-month age 
intervals from 36--38 months to 78-80 months, these tables 
give the numier of children, the mean score, and the standard 
deviation at each age level for the following subgroups of 
the HSPV sample: total sample (Table 10) , males (Table 11) , 
females (Table 12) , children with previous preschool experience 
tTable 13), children with no previous preschool experience 

(Table 14)^7" vhite phildr^ (Table 15) , black children (Table 

16) , and Mexican-America^n~~children (Table 17) . The mean score 
for the total sample (N = 2972) was 14.585 (S.D. == 6.163). 
Scores in all the "tables increased with age-. The difference 
in mean scores for males (14.189, S.D. = 6.177) and females 
(14.995; S.D. = 6.121) was less than one point. There was a 
large difference (3 points or one-half of ,a standard deviation) 
between means for children with previous preschool experience 
(17.131, S.D. = 6.308) and children wiLh uo previous preschool 
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TABLE 3 

DISTRIBUTION OF 64-ITEM PSI SCORES FOR ALL CHILDREN 
■IN THE FAXL 1970 HSPV SAMPLE^ 



Age (Months) 



42-44 
45-47 
48-50 
51-53 
54-:n6 
57-55* 
60-62 
63-65 
66-68 
69-71 



TOTAL 



N 



8 
63 
204 
316 
341 
348 
270 
228 
1-8 0 
176 



2134 



Mean Score' 



20.500 
24.667 
27.108 
30.203 
33.179 
35.589 
38.867 
39. 978 
41.006 
43.244 



35.188 



S.D. 



11.533 
10.788 
9. 955 
10.914 
11.605 
11.047 
11.468 
11.123 
10.905 
10.918 



12.216 



"Includes all children; not in LeveL I sites, Oraibi or 
Fresno; who had adequate information on sex, age, race 
and preschool experience. 

Maximum score = 64. 
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TABLE 4 

DISTRIBUTION. OF 64-ITEM PSI SCORES FOR ALL CHILDREN WITH 
PREVIOUS .PRESCHOOL EXPERIENCE IN- THE FALL 1970 HSPV SAMPLE 



Age (Months) 


N 


Mean Score 


S. D. 


42-44 


0 






45-47 


6 


32.500 


14.683 


48-50 


22 


30.727 


10.639 ' 


51-53 


28 


31.643 


11.539 


54-56 


S9 


37.559 


10.890 


57-59 


61 


37.902 


9.220 


60-62 


69 


42.870 


11. 547 


63-65 


68 


43.382 


10*. 637 


66-68 


47 


42.936 


11.358 


69-71 


47 


47.298 


9.516 


TOTAL 


407 


40.378 


11.737 



Includes children; not in Level I sites, Oraibi or Fresno; 
who had adequate information on sex, race, age,- and preschool 
expexience. 

2 

Maximum score = 64, 
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TABLE 5 

DISTRIBUTION OF 64-ITEM PSI SCORES FOR ALL CHILDREN WITH 
NO PREVIOUS PRESCHOOL EXPERIENCE IN THE FALL 1970 HSVP SAMPLE 



Age (iMonths) 


N 


' ■- ; 

2 

Mean Score 


— — 

S.D. 


■■' " 

42-44 


•— ' ' 

8 


20.500 


11 .533 


45-47 


57 


23.849 


9.940.. 


48-50 


182 


26. 670 


9.779 


51-53 


288 


30.063 


10.841 


54-56 


282 


32.262 


11.54 0 


57-59 


287 


35. 098 


11.338 


60-62 


201 


37 . 493 


11.078 : 


63-65 


160 


38 .531 


11.009 i 


66-68 


133 


40.323 


10.657 


69-71. 


129 


41.767 


11.022 


TOTAL 


1727 


33.965 


12.004 











Includes children; not in Level I sites, Oraibi or Fresno? 
who had adequate information on sex, race, age, and preschool 
experience. " *5 



Maximum score = 64. 
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TABLE 6 

DISTRIBUTION OF 64-ITEM PSI SCORES FOR BLACK CHILDREN 
IN THE FALL 1970 HSPV." SAMPLE 



■ 1 

Age (Months) 


N 


•5 

Mean Score" 


1 

S.D. 


42-44 


3 


25.333 


11.441 


45-47 


39 


24 .667 


9.444 


48-50 


128 


26. 813 


9.257 


51-53 


171 


29.427 


10.447 


54-56 


187 


32.059 


11.530 


57-59 


190 


34.463 


10.710 


60-62 


108 


36. 169 


10.413 


63-65 


107 


39. 617 


9.973 


66-68 


84 


39.548 


10.208 


69-71 


105 


41. lU 


11.420 


TOTAL 


1122 


33.774 


11.622' 



Includes children; not in Level I sites, Oraibi or Fresno; 
who had adequate information on sex, age, race, and preschool 
experience . 

2 . 

Maxiinum score = 64. 
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TABLE 7 

DISTRIBUTION OF 64-ITEM PSI SCORES FOR WHITE CHILDREN 
IN THE FALL 197 0 HSPV SAMPLE"'- 



Age (Months) 




Mean Score 


S.D. 


42-44 


5 


17.600 


10.575 


45-47 


24 


24.667 


12.671 


48-50 


67 


2 8.209 


11.433 


51-53 


118 


31.492 


11. 568 


54-55 


124 


35.548 


11. 658 


57-59 


117 


38.410 


10.957 


60-62 


108 


41.407 


11.546 


63-65 


86 


42.965 


10. 870 


. 66-68 


60 


45.583 


10.18 5 


69-71 


50 


47. 600 


8.911 


TOTAL 


759 


37.510 


12 . 802 











■'■Includes children; not in Level I sites, Oraibi or Fresno; 
who had adequate information on sex, age, race, and preschool 
experience. 

2 

Maximum score ==64. 
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TABLE 8 



DISTRIBUTION OF 64-ITEM PSI SCORES FOR FEMALES 
.IN THE FALL 197 0 HSPV SAMPLE-^ 



Age (iMonths ) 


N 


2 

Mean Score 


S.D. 


42-44 


4 


19.750 


13.141 


45-47 


33 


23.879 


8 . 943 


48-50 


102 . 


29.382 


10.186 


51-53 


150 


30.567 


11.342 


54-56 1 


176 


33.778 


11.535 


57-59 ■ 


160 


36.256 


10. 613 


60-62 


136 


38.051 


11-366 


63-65 


116 


39.784 


11-439 


66-68 „ 


89 


42.011 


11- 268 


69-71 


84 


43.583 


10.864 


TOTAL 


1050 


35.605 


12.127 



Includes children; not in Level I sites, Oraibi or Fresno; 
who had adequate information on sex, race, age, and preschool 
experience . 

2 . 

Maximum score = 64, 

O 
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TABLE 9 

DISTRIBUTION OF 64-ITEM PSI SCORES FOR MALES 
■IN THE FALL 1970 HSPV SAMPLE""" 



Age (Months) 


N 


2 

Mean .Score 


, S.D. 


42-44 


4 


21.250 


9.601 


45-47 


30 


25. 533 


12.449 


4 8-50 


102 


24. 833 


9.172 


51-53 


166 


29.87-3 


10.502 


54-56 


165 


32. 539 


11.644 


57-59 


188 


35.021 


11.374 


60-62 


134 


39. 694 


11.512 


63-65 


112 


40.199 


10.782 


66-68 


91 


40. 022 


10.444 


69-71 


92 


42.935 


10.958 


TOTAL 


'lOBA 


34.785 


12.289 



1 

Includes children; not in Level I sites, Oraibi or Fresno; 
who had adequate information on sex, age, race, and preschool 
experience. 

^Maximum score =64. 
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TABLE 10 



DISTRIBUTION OF 32-ITEM PSI SCORES FOR ALL CHILDREN 

1 

IN THE FALL 19 71 HSPV SAMPLE 



Age (Months) 



N 



Me am Score 



S.D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



4 


7.750 


4. 815 


4 


6.750 


1.479 


10 


8. 316 


3.948 


70 


10.486 


4.628 


248 


10.835 


4.733 


451 


11.410 


5.061 


46 8 


12.571 


5.076 


461 


13.733 


5.260 


389 


16.470 


5.632 


269 


17.156 


' 5.520 


267 


18.311 


5.494 


222 


20.144 


,5.761 


92 


- 20.054 


6.0 30 


5 


16.800 


9.704 


3 


12,667 


'6.944 


29 72 


14.585 


6.163 



^Includes all children with adequate age information 
not in Level I sites. 

^Maximum score =32. 
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TABLE 11 



DISTRIBUTION OF 32-ITEM PSI SCORES FOR MALES 
IN THE FALL 19 71 HSPV SAMPLE-"- 



Age (Months) 


N 


2 

Mean Score 


S.D. 


36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 


1 

e 

43 

123 
235 
241 
233 
207 
124' 
142 
103 
49' 
3 
2 


■'.ooo 

8. 000' 
10.605 
10.927 
10. 821 
12.166 
13.129 
lb. 295 
16.726 
17.669 . 
19.670 
19.898 
24.667 
17.000 


/ 

3.464 
5.297 
4. 811 
4.951 
■ 5.138 
5.188 
5.538 
5.669 
5.524 
6. 30 7 
6.149 
1.247 
4.000 


TOTAL " 


1512 


• 

14.189 


• 

6.17", 


\ 

X— 




1 
1 





'Includes all children with adequate age information 
^lot in Level I sites. 

Mcocimum score = 32. 



TABLE 12 

DI-STRIBUTION OF 32-ITEM PSI SCORES FOR FEMALES 
* IN THE fALL 19 71 HSPV SAMPLE^ 



Age (Months ) 




2 

Mean Scpre 


S.D. 


36^^38 




A 


/ • / J u 


*x . O X J 


39-41 




3 


6.667 ; 


1* 7oa 


42-44 






o • 4 O ^ 


«t • X *i 'x 


45-47 




27 


10.29B 


3. 287 


46-50 




125 


10.744 ■ • 


.. 4j654 


51-53 




216 


. '12.051 


5.lOi 


. 54-56 




221 


IS. 000 


4.975 


57-59 




228 


14.331 


5.262 


60-62 




182 


16.670 


■ 5.729 


63-65 




145 


17.524, 


5.363 


66-68 




125 ' 


19.040 


5.367 


69-71 




119 


20.555 


'5.20 8 


72-/74 




43 


20,233 


' 5.886 


75-77 




2 


5.000 


.1.000 


78-90 




1 


4.000 ~ 




TOTAL 




1460 


14.995 


6.121 























Tncludes all children with 
not in Level I sites. 

\ 

Mcocimum score = 32. 



adequate age in format ion 
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TABLE 13 



DISTRIBUTION OF 32-r^EM PSI SCORES FOR ALL CHILDREN WITH 
■ PREVIOUS PRESCHOOL* EXPERIENCE IN THE FALL 1971 HSPV-SANIPLE 



Age (Months) 


N 


Mean Score 


S.D. 


36-38 









39-41 








42-44' ■ 


2 


; 12.00 0 


3.000 


45-47 


6 


13.000 , 


3.266 


48-50 


35 


12.: 43 


5.861 


51-53 


63 . 


13.048 


5.311 ^. 


54-56 


57 


13.193 


5. £02 ' 


57-59 


81 


14.9 75 


5.5 89 


60-62 


121 


17.694 


5 ,614 


63-65 


99 


17.192 


5.810 


66-68 


96 


•19.6 77 


5.090 


69-71 


qg 


20.576 


5.822- . • 


72-74 


1 


'22.150 


5.213 


75-77 


3 


24.667 


1.24 7 


78-80 


2 


8.500- 


4.500 


• 

• TOTAL • 


7o 1 


17.131 


6.30 8 


1 

1 


1 




ft 



••Includes all childjren with adeqiv.te age information 
not* in Level -I sites. 



' • ?Maximiain score = 32. 
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TABLE 14 

DISTRIBUT I ON OF 32- ITEM PS I SCORES FOR ALL CHILDREN WITH 
NO PREVIOUS PRESCHOOL EXPERIENCE IN THE FALL 19 71 HSPV SAMPLE 



Age (Months) 


N 


' 2 
Mean Score 


S.D. 


36-38 


4 


7. 750 


4.815 


39-41 


4 


6.750 


1.479 


42-44 


16 


7.625 


3.789 


45-47 


63 


10.159 


4.647 . 


48-SO 


207 


10.628 


,4.512' 


51 S3 


374 


11. 176 


4. 932 


54-56 


39 7 


12.542 


5.024 


57-59 


36 8 


13.380 


5.112 


60-62 


2S1 


15.887 


■ 5.556 


63-65 


16 2 


17.019 


■ 5.395 


66-68 


165 


17.442 


5. 586 


69-71 


119 


19.924 


5.545 


72-74 


52 


18.442 


6.119 


75-77 


2 


5.000 


1. ' )0 


78-80 


1 


'21.000 




TOTAL 


2191 


13.775 


5.8-88 



includes all childi'on with adequate age in format : .,>n 
not in Love! 1 sites. 

2 

Maximurrk . ore » 32 » 

r 

ERIC • ^ 



TABLE 15 

i 
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1 

i \ 



DISTRIBUTION OF 32-ITEM PSI SCORES j^OR vmiT.E CHILDREN 

■ ■ ■ \ 

IN THE FALL 19 71 HSPV SA^1PLE■'■ 



Age (Months; 


N ' 


2 

Mean Store 


S.D. 


36-38 














39-41 


3 


7.333 


1.247 


— 4 *4 


7 


S 71 4 
o • / 


4 R 9 


45-47 


31 


11.097 


5.526 


48-50 


91 


12. 341 


5.263 


51-5 3- 


•177 


13.119 


5. 564 


54-56 


203 


14.079 


5.464 


57-59 


187 


15.176 


5.137 


60-62 


164 


17.762 


5.484 


63-65 


9 5 


18.147 


" 5 . 113 


66-68 


99 


19.36 4 


5.221 


69-71 


82 


22.012 


5.339 


72-74 


52 


20.962 


5.170 


75-77 


3 


24.667 


1.247 


78-80 


. 2 


8.500 


4.5 00 


• 








TOTAL 


1196 

1 


15.977 


6.172 



Includes all children with 
not in Level I sites. 

Wximujn score = 32. 



adequate age in format ion 
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TABLE 16 

DISTRIBUTION OF 32-ITEM PSI 'SCORES FOR BLACK CHILDREN 
IN THE FALL 19 71 HSPV SAMPLE-*- 



Age (Months) 


N 


Mean Score^ 


S.D. 


36-38 


4 


7.750 


4.815 


39-41' 


1 


5.000 ■ 




42-44 


12 


8.083 


3.303 


45-47 


39 


10.000 


3.G93 


48-50 


135 


9.830 


4.130 


51-5 3 


202 


10.124 


4.313 


54-56 


203 


11.148 


4, 338 


57-59 


194 


12. 711 


5.153 


60-62 


149 


15. 101 


5. 311 


63-65 . 


123 


16.041 


" 5.235 


66-68 


115 


17.913 


5. 320 


69-71 


117 


18. 838 


5.756 


72*74 


38 


19.026 


6. 819 


75-77 


2 


5.000 


1.000 


78-80 


1 


21.000 




TOTAL 


1335 


13.382 


5.918 



'Includes all djildren with adequate age information 
no,t in Leve^l I sites. 

'Maximum score = 32." 
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TABLE 17 

0 • " 

DISTRIBUTION OF- 32-ITEM --PSI SCORES FOR MEXICAN AMERICAN 
CHILDREN IN THE FALL 19 71 HSPV SAMPLfc"'" 



•Age (Months) 


N 


Mean Score 


S.D. 


36-38 
39-41 

A ^ A A 

42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
' 72-74 
75-77 . 
78-80 

TOTAL 


19 

67 
51 
66 
67 
49 
50 
19 

388 : 


















11.684 
10 .716 
12.235 
13.348 
- 16.075 
17.837 
■ 17.160 
20.158 


3. 742 
4.428 
4.676 

4. 845 
5.503 
6.428 

" 6.130 

5. 304 










14.528 


5.973 



'Includes all children with adequate age information 
not in Level I sites. 



Mciximujn score = 32. 
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experience (13.775, S.D* = 5.888). The mean score for white 
children (15.977, S.D. = 6.172) was higher than the mean 
score for Mexican-American children (14.528, S.D. = 5.973) 
and for black children (13.382, S.D. - 5.918). 

» 

Reliability 

64-item PSI ^ In general, the reliability estimates 
for the 64-item PSI are high. Two kinds of reliability 
estimates — KR-20's and split-half (odd-even) coefficients, 
corrected for length by the Spearman-Brown formula — are 
listed in Table 18 for each of the age groups in the 
standardization sample (Cooperative Tests and Services, 
1970, p. 21) . 

The alpha coefficient for the total ETS sample was 
• 92 in Year 1 (n « 1467) and .93 in Y'ear 2 (n = 1311). The 
correlation between Year 1 and Year 2 scores was .66, one of 
the highest stability cpefficients i^ the ETS study . (Shipman, 
1972)*. 

Reliability estimates (KR-20'§) for the total sample 

♦ 

and subsamples in the Fall 1969 and Fall 1970 HSPV samples 
are listed in Tables 19 and 20. The KR-20 for the Fall 1969 
sample was .925. The range of the 55 coefficients calculated 
.for the Fall 1969 scores (Table 19) was from .825 ^(n = 15) for 
northern old white child an with previous preschool experience 
to .938 (n =175) for northern children with previous pre- 
school experience. Only two coefficients out of 55 were below 
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TABLE 18 

INTERNAL RELIABILITY ESTIMATES FOR THE 6 4-ITKM 
PS I TEST BASED ON THE HEAD START STAWDARDIZATI ON 
SAIxPLE FAj^L 1969 . 



Age 


Group 


n 


KR-20 • 


Corrected Solit-Half 


3-0 


to 3-11 


158 


.88 




.84 


4-0 


to 4-5 


528 


. 88 




.89 


4-6 


to 4-11 


' 438 


. 86 




.90 


5-0 


to 5-5 


259 


. 89 




.90 


5-6 


to 6.5' 


148 


.92 




.93 




TO'TAL 


1531^. 


.91 




.92 






*• 









ERLC 



1 . 

Reported by Cooperative Tests and Services, 1970, 
in Preschool Inventory Revised Edition - 1970; 
Handbook, ^ 



/ 

/ 
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TABLE 19 

KR-2Q RELIABILITIES -FOR FALL 1969 HSPV 64-ITEM PSI SCORES 





n 


mean'^ 


S.D. 


KR-20 


, 1 

Total 


1674 


38. 550 


1 

1 

12.116 


.925 


Black 


1163 


37.017 


■ 12.194 


.9 25 


White 


511 


42.039 


11. 192 


.915 


Male 


811 


37.629 


12.226 


. 925 


Female 


857 


39.473 


11.919 


.924 


Youna^ 
X oung 


799 


32 229 


11.076 


90(1 


Old 


875 


43.409 


10. 931 


.913 


Previous 
Preschool 


541 


43.996 

a 


11. 561 


.925 


No Previous 
Preschool 


1133 


35.950 


11. 501 


.913 


North 


636 


36. 030 


12.914 


.935 


South 


1038 


40.094 


11.333 


.914 



Sainplo incliidos all blacks and whites between 35 and 7? 
months at October 1 1969, who had a fall test scoix- and 
data on the previous preschool experience questioii. 

^Maximum score is 64. 

oung is less than 60 niojiths old is y reater than 59 months - 
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TABLE 20 

KR-20 RELIABILITIES'' FOR FALL 1970 HSPV 64-I!IEM PSI SCORES 





n 


mean2 


S.D. 


KR-20 [ 


Total^ 


2591 


35,185 


12. 184 


.924 


Black 


1314 


33 . 808 


11 . 515 


.915 


White 


935 


37.440 


12.798 


.933 


Male 


1337 


34.632 


12. 214 


.524 


Female 


12d4 




Ton 
Iz . 1 30 > 




Young ^ 


1151 


30. 387 


11.382 


.911 


Old 


1439 


39.035 


11.413 


.915 . 


Previous 
Preschool 


476 


, 40.2 45 


' 11.771 


.923 


No Previous 
Preschool 


2108 


. 34.003 


11.983 


.921 


North 


1503 


34. 239 


12. C 81 


.922 


South 


10':,ti 


36.491 


12. 2 11 


.926 



Sample includes all children who wcr-e not in a Cevel I site 
or Oraibi between 32 and 79 months at October 1, 19 70 . 

Note: 98% of the children were between 41 and 71 months. 

Spanish-speaking children are included in the total 
sample. 

"^Maximum score is 64. 

-^Young is ""ess than 57 months; old is greater than 56 months. 
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• 88. The KR--20 for ^-he Fall 1970 sample was .924. The range 
of coefficients for the Fall 1970 PSI scores (Tabl^^ 20) was 
from ,832 (n = 45) for southern young blacks with previous 
preschool experience to .947 {n = 45) for young whites with 
previous preschool experience. Only four KR^20's were under *« 

• 8b. 

32-it--'^ PSI > In Fal]. :.971 the 32-item version of the 
PSI was included in a test-retest/inter-tester reliability 
study conducted by the Huron Institute and SRI. Details of 
this study using two sites in the third year HSPV sample are 
reported in Appendix A. In general, the test-retest relia- 
bilities were high and there were no significant tester 
effects. The range of test-retest coef f icients , f or a sample 
of approximately 20 children af ter ,a two week interval was 
;rom .833 (paraprofessional B parapro Sessional B) to .952 
(parapiofessional A - paraprofessional A) . ■ Internal consis- 
tency estimates (KR'-20*s) were high, considering the sample 
was small. The KR-20 v;as .84 for the test condition (n ^ 152) 
and '.84 for the retest condition (n = 142). 

Internal consistency coefficients (KR-20's) for the 
Pall 1971 HSPV total sample and m.ain subsamples are listed m 
Table 21. ^ The KR-20 for the total sample (n = 3176) was .824 . 
■The KR~20's for 92 subsamples with a size greater than 20 
ranged from .681 for young black males with no previous pre- 
school experience (n = 241) to .905 for Mexican-Ttocrican female 
with previous preschool experience {n..= 21). About tv;o-thirds 
(67%) of these KR-20's were greater than .80 while only 4% were 
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.7 




TABLE 21 




• 


' KR-20 RELIABILITIES 


FOR FALL 1971 


3 2 -ITEM 


PSI SCORES 


• 


n 




S.D. 


KR-20 


Total"'' 


3176 


14.449 


6.158 


.824 


Black 


1415 


13.224 


5.912 


.815 


White 


1277 


15.876 


6.173 


.825 


American 


4 25 


14.337 


6.004 


.813 ^ 


Male 


1574 


14.111 


6.172 


.826 


Female 


1526 


14.896 


6.156 


.823 ' 


Young^ 


1338 


11.565 


5.082 - 


.765 


Old 


1741 


16.752 


5.981 


^811 


Previous 
Preschool 


■ 760 


16.896 


6 .400 


.837 


No Previous 
Preschool 


2336 


13.652 


5.877 


.810 



Includes all children with adequate., age information' not 
•in Level I sites. ^ 

o- . ■ 

Maximum score =32. 

Young is less than 57 months; old is greater than 56 months. 
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greater than .85. If thei Spearman-Brown fo:rinula is applied to 
the 32-item PSI reliability estima*:o (.824), tjie estimated 
reliability for a test double irf length is .9^4. This estimate 
is almost identical to the KR-20's calculated for the Fall 1969 
{KR-20 = .925) and Fall 1970 (KR-20 = .924) 64-item PSI scores. 

The internal consistency reliability {alpha coefficient) 
for the Fall 1972 Home Start sarrple (n not given) was .83 

(Hi/Scope, 1973) . 

'f 

29-item PSI , In the Fall 1971 Follow Through evaluation 
(Emrick, 1972), the .29-item version of the PSI was included in 
a supplementary battery given to kindergarten and entering 
first grad^ children in 17 projects. The measures of internal 
consistency were adequate for the test and retest given two 
to three vfeeks later. The range of KR-20 coefficients was 
.673 to .964 (average .834) for the test condition and .^62 
^to .933 (average 839) for the retest condition. The t^st- 
retest coefficient for the entire sample (n = 597) after a 
2-3 week interval was .845. 

» 

Item ai>d Score Characteristics 

64-item PSI . In the standStdization data test difficulty 

' is measu^red by expressing' mean raw scores as a perce»tage''of 

• _ / - ' • * f 

1 2r i^ 

i j^* = ^ where r^ = estimated reliability for test double 

1+r 

and r = . reliability 4^f test. 
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0 " 

the total nuxT±)er of questions on ^ the test. Three-year^plds 
got an average of forty percent test questions correct" 
while children five-and-a-half to six-and-a-half got an 
average of about siyty-six percent correct. The standard- 
ization sample, did not indicate celling effects, although 
further subgroup analyses might reveal 3\ach effects for 
certain older groups. Mean biserial . correlation^ between 
each item and total score of children inc'reased with aqe, 
ranging from .45 (3-0 to 3-1) to .56 to 6-5). 

(Cooperative Tests and Services., 1970) - 

Close analyses of the' frequency distributions for fall 
196^ and spring 1970 PSI scores, of four HSPV subsamples 
(young white, young black, .old white, old' black) reveal 
there is a ceiling ef feet "the spring scdfe^^'Dt' cdrdGr white 
children (see Table 22 ) . In spring 1970 twenty percent of 
the older white children were at the threq top scores, 
(score 62 — 6%; score 63 — 10%; score 64 — 4%). 
* Factor ° analyses don^ by Shipman e^. al« (197J) on the 
ET^S Lpngi.tudinal sample and by the Huron Institute on the 
fall 1969 HSPV sample do not find the four factors which" were 
found in the priginal study. The factor analysis dene on one 
s-ubgroup in the 1969-70 HSPV data (older blacks in Fall-*1969) 
revealed the^ existence of onl^ one factor. The first three 
eigenvalues obtained were 9.3C, 2.54, and 2.15. The first 
value accounted for 14.5% of the total varitnce.-* 
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^ 32-ite m PSI . "Tfte distribution of .32-item PSI scores 
for the Fall 197^ and "Spring 1972 HSPV samples were normally- . 
shaped. Ther^ was . lyo indication of a ceiling effect for the 
total sample or any possible subscLnples in either fair or 
spring . ' - " , 

< A principal commorients analysis followed by a varimax 
rotation of the Fall 1971 HSPV 32-iteiT\ PSI scores substantiated 
the existen'^e of one general factor. The analysis produced 
9 eigenvalues greater than 1.0; the sum of 9 factors accounted 
^for 47%^ of the variance. The largest ei'gcnvalue was 5 .973 whicifi 
accountea 'Tor 19%- of the total variance. The next eight 
eigenvalues rangecJ from 1.452 to 1.002. A similar factor 
analysis done on the Home Start Fall 1972 data confirms the 
HSPV finding of -one factor. In the Home Start analysis, the 
first factcr accounted for 18% ,^of the total variance (Hi/Scope, 
197^3) . . ^ 

The percent passing each item of the 32-item .PSI for five 
age groups (3-1/2, 4,. 4-1/2, 5, 5-1/2 years) of the Fall 1971 
HSPV sample are listed n Table 23. The rtiv^st difficult items 
across all the age groups were items **17 (How na-iV t oo.^ do 'you 
have?), #24 (Which of 2 groups has more checkers?), i^l (Put 
2 cars behind the middle box), #10 {Where would you look for 
a lion?) , and #22 (Point to the second checker) • The easiest 
item for all age groups'was iter, #1 (?%hat :s your fi'^st na.T»e?) . 
Other items which were relatively easy for all ace groups were* 
#2 (Show me your shoulder-^ , 125 (Point to- the <^rawing !r,c3t like 
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TABLE 23 

32-ITEM PRESGHOOL INVENTORY: PERCENT PASSING EACH ITEM 
^ 

9 



Ages 



ITEM 


3-1/2 


4 


4-1/2 


5 


5-1/2 


1 


91 


93 


89 


90 


93 


2 


69 


65 


69 


78 


87 


3 


51 


60 


65 


75 


83 


4 


30 


38 


45 


60 


67 


5 


20 


36 ^ 


43 


52 


61 


6 


08 


21 


22 


34 


40 


7 


06 


08 


10 


17 


25 


8 


51 


49 


56 


64 


71 


9 


24 


31 


36 


49 


57 


10 


06 


16 


24 


34 


36 


11 


26 


25 


38 


53 


60 


12 


12 


32 


35 


44 


48 


13 


08 


21 


24 


33 


40 




32 


48 


52 


63 


71 






47 








16 


08 ' 


19 


24 


38 


54 


17 


00 


02 


03 


07 


14 


18 


34 - 


53 


56 


61 


66 


19 


•20 


36 


44 - 


56 


72 


20 


18 


30 


31 


41 


48 


21 


14 


20 


25 


33 


47 


22 


08 


15 


17 


20 


33 


23 


22 


37 


36 


44 


42 


24 . 


00 


04 


05 


12 




25 


59 


66 


68 


78 


81 


26 


- 02 


14 


22 


38 


57 


27 


02 


06 


08 


20 


35 


28 


59 


58 


58 


68 


75 


29 


18 


33' 


39 


44 


50 


30 


30 


31 


33 


42 


49 


31 


22 


37 


41 


49 


60 


32 


22 


50 


54 


67 •■ 


77 


n = 


49 


^01 


912 


835 


521 



Intervals include 2 months before and 4 months after 
indicated age ( e,g, , 4-year-old category includes children 
from 46 to 51 months) . 



a tent) , and #28 (Which one [of the crayons] the color of 
night?) . For the remaining items ^ the percent passing 
increased with age. ' * 

The percent passing each item of the 32-item PSI were 
also computed for the Home Start pilot data (Hi/Scope, 1973) • 
In general, the findings were very similar to the HSPV results 
The most difficult' items for all ages were #7, #17, #24, #26 
(Make one like this [point to square].) and #12 (Which way 
does a phonograph record go?) . The easiest item for all ages 
was item #1. ^ 

Item intercorrelations and item-total correlations for 
the HSPV Fall 1971 data are -listed in Table 24. In general 
all of the item intercorrelations were low. None were 
negative and the few highest :^^re in the .40 's» The item 
intercorrelations computed for the Home Start data XHi/Scope, 
1973) were also low; a few of these correlations were negative 

The item-total correlations (not cor^rected for overlap) 
for the HSPV data ranged from .I4(item #1 - What is your first 
name?) to .59 (item #19 - Point to the middle checker). The 
mean item total correlations was .42. Seven of the correla- 
tions were greater than .50, and two (item #14 and item #23 - 
Which of these two groups has less checkers in it?) were less 
than .20. . 

The item-total correlations (corrected for overlap) for 
the Home Start data (Hi/Scope, 1973) ranged from .03 (item 
#22 - Point to the second checker) to .54 (item #6 - Put the 
^'"lue car under the green box/ and item #19 - Point to the 



365 



O 



D 



IN ^ 4ft 



■ ooooo— oooo— o 



c ooooooooooo ooooc oooooooooooooo 



ERIC 



366 ' 

middle; checker) . The mean item-total correlation w^s .34. 
Three of the correlations were greater than .50, and five 
were less than .20. 

' 29-item PSI . The mean score for the overall Follow 
Through fall 19 71 upplementary battery sample (n = ^^51) 
for the test condition was 16.7 (about 58% correct) with 
a standard deviation of 5.71. Initial test mean scores 
for the 17 projects ranged from 12.6 to 20.0.. The overall 
difficulty levels, which ranged generally from 30% to 70%, 
seemed -appropriate for this sample. The few items which 
were the easiest or most difficult on the pretest were also 
the easiest or most difficult on the posttest. The easiest 
items are at the beginning of . the test. There did not seem 
to be any ceiling or floor effects in the scores for this 
sample (Emrick, 19 72) . 

Correlations with Other Tests 

64-item PSI . Correlations of the 64-item PSI scores 
and Stanford-Binet IQs are available for the standardization 
sample (Cooperati"ve Tests and Services, 1971). The correla- 
tions ranged from . 3^^ (ages 3-0 to 3-11) to .65 (ages 5-0 to 
- 5-5) . 

Correlations of the 64-item PSI scores with the NYU 
Booklets 3D and 4A, the Motor Inhibition Subtests, the CPSCS , 

the Eight-Block Sort success scores, and the Stanford-Binet 
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IQ and MA for the fall 1970 HSPV sample are listed -in Table 25. 
Correlations with the NYU Booklet 3D (.696) and the^ Stanford- 
Binet MA (.756) are the highest. The former, correlation is 
a good concurrent validity estimate for the P$If since the '3D 
Booklet is an achievement test which measures many similar 
relational concepts. The lower correlation (.467) between 



the 4A Booklet and the PSI is not surprising since the PSI 
only incl^ides a few items of recognizing numbers, letters, 
and shapes. If the correlations with the NYU Booklets ar'e 
corrected for unrei'iability^ , the estimated correlations 
between the true score components of the tests are .90 for 
Booklet 3D and .59 for Booklet:4A. 

The correlations . of the PSI with the other tests in the 
ETS Longitudinal Study (Shipman, 1972) support its use as an 
achievement measure. Correlations with other cognitive-per- 
ceptual tests were the highest. The cojcrelation with the 
PPVT was .58 "in Year 1 and .66 in Year^2/ Other 64-item PSI 
correlations of interest in the ETS Study are .47 in Year 1 and 
•53 in Year 2 with the Eight-felock Sort Total Success Score, 
• 30 in Year 1 with ETS Enumpration I (pointing items), and .58 
in Year 2 with ETS Enumeration II (counting items). In the 
factor analyses of Year 1 and Year 2 data, the KSI had the 



Using, formula * = where ^^.2 correlatioh- 

hetween the two tests and tj^, t2 are the reliability estimates 
|g|^^)r the two tests. 
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highest loading of any measure on the "g" factor (general 
information-processing skills) , 

' 32-iteni PSI , Correlations of the 32-item PSI with 
other tests in the Fall 1971 HSPV battery are presented in 
Table 26. The PSI had the highest correlations of any test 
in the battery. The PSI correlated highest with the PPVT 
(•665) f the ETS Enumeration-Counting Subtest (,625) and 
the ETS Enumeration Total Score ( . 584) ."\Correlatibns with 
the Fall WRAT subtests were in the . 40- . 50 Vange . The PSI 
correlations with the Eight-Block Sort scores were .305 
(Placem.ent) , .443 (Reason), and .440 (Total). Conft. Nations 
with the Brown Self-Concept Test, the Mi-Truck Subtest , and 
the Touching and Same Number Matching SubCests of the ETS 
Enumeration Test were low. 

29-item .PSI . Correlations of the 29-item PSI with 
the Brown Self-Concept Test, the ITPA- Verbal Expression Sub- 
test, and Faces Test were calculated for the fall 19 71 Follow 
Through supplemental battery sample (Emrick, 1972). Correla- 
tions with the Brown were ,293 (test) and .378 (retest) ; 
with FaceSj .315 (test) and .334 (retest); and with the 
ITPA-Verbal Expression Subtest, .556 (test) and .517 (retest)* 

Remarks 

The PSI is one of the best tests in the HSPV battery. 
It is unpretentious aibout what it is trying to i^easure, and 
because it assesses concrete attainments and verges on being 
^ a criterion-reference measure, it can claim a face-validity 
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'hat other tests cannot. The PSI seems to be an adequate ' ' 

measure of a young child's achievement. The 3 2 -item version 
may be more useful in future large scale evaluations than the 
64-item version since, in additi9n to being shorter to give, 
it has adequate reliability coefficients without any ceiling 
effects in scores. Despite tiie excelle'nt technical information 
already available on various forms of the PSI, there are some 
limitations which need to be resolved in future studies: . 

1. The ETS Study (Shipman, 1972)' finding that there are 

. large differences amiong SES groups jon the 64-item PSI indicates 
that experience is necessary for the development of general 
knowledge and substantiates the test designers' claim that the 
test is not "culture-fair." ^ The designers' tiefusal to create 
a culture-fair test was based on the assumption that there 
are a number of skills which every child, Whatever his back- 
groiind, will have to possess to be successful in kindergarten. 
It was argued that such a test should reflect the biases of 
the school rath'er than mask them, since, all children sooner or 
later have to succeed or fail according to School-defined notions 

. of achievement. *Phis assumptions seems defensible, and even 
laudable, if the test really doe^ tap generally necessary 
skills and knowledge. But some critics have suggested that 
the answers to certain PSI items reflect regional or ethnic 
biases which do not have any influence on school success. Thus, 

, when a child is asked where he would expect tp find a lion, he 
m.ight answer, "in a book " or "in the woods" as easily as "in 
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the zoo"; but by tlie PSI scoring systfm such an answer would - 
bei^. marked wro^ng. ^^"STji^wisei in the case of 'the question^ "Who' 
do you go to when you feel sick?" it is wrong in the PSI for 
the child to say he would go to the hospital. The correct . 
answer is "to a doctor" or "to a nurse," Continued item 
development should rectify such problems,, 

2, On some PSI items, the child is required to identify 
or reproduce two or more attributes simultaneously in giving 
his answer. A problem arises since -some items are, scored 

•to allow- a partially correct answer and some are not. Thus, 

on the test item requesting that the child "color the triangle 

orange"^ one p6int is given .for selecting the correct geo- 

metric configuration and another for^ using the right color* 

But on' the item requesting that the child "put the yellow 
* V, 
^ , - • . '^-^ ' 

car on the little box" , the child's response is 'either marked 
entirely correct or entirely incorrect., regardless oi. the 
fact that a judgment of color/ of size, and of relation must 
be made. Critics suggest that credit should aiways be given 
for the understanding of individual task dimensions. 

3, The PSI. may have stronger practice effects than 
other tests. Study of such effects is needed. 

4, Predictive validdty estimates are needed for all 
forms of the PSI, 
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Relevant Redundant Cue Concept Acquisition Task 
Purpose 

The Relevant Redundant Cue Concept Acquisition Tost 
(RRC) also called "Zings and Peggies , " v/as designed to 

■measure concept acquisition^^ learning ability^ and attention 
to the learning process. Te^ts of this Lype provide a moans 
of studying inductive reasoning processes in children. In 

""ctdjdition to showing something about learning rates r the con- 
c6pt acquisition task yields information about the strategies 
t-he child uses in learning a task in which two or more di- 

-merisions are redundaivt-^ The concept acquisition *strategi^-s 
of children seem especially^ imp6rtant to study during an 
age period when^ these strategies are hypothesized to be 

'changing (Weir, 1964). 

r 

Description 

The task consists of 64 cards on which circles, rectangles 
and triangle^ are drawn.' The first 48 cards are used as 
part of the "training series while the remaining 16 are 
used as . the "transfer series" or test. In the training 
series, the child is shown a set of cards one at a time. 
The child is asked to guess if the card is a "Zing" '(green and/ 
rectangle) or a "Poggle" (red ancVor diamond; . Durinq- ti\o tr^-^n 
period the child is told if his guess is correct and encouraged 
to study the cards to ^determihe the difference between "Zings" 
and "Poggles." The/training period is continued until the 



entire deck is exliausted or until the child has given twelve 

consecutive correct responses. During the "transfer" or 

"testing" period the child is asked to identify the "zings" 

and "poggles" in a set of 16 cards with no help from the 

tester • A score^of "1" is given for each correct answer in 

the "transfer series." 'All other responses during the testing/ 

transfer series are coded as follows; refusal, don't know, 

request aid," no response /-''black , green,, red, other color, 

oval, circle, square, rectangle, diamond, other shape, other name. 

■J 

Development of instrument 

The RRC was developed by Educati6hal Testing Service 
in the late 1960 's for use wi%h four-to-nine-year-old child- 
ren in their longitudinal study of disadvantaged children (1968) . 
Analyses of the RRC. results, will be px±)lished in a future 
report on year II of their study. Since the RRC is a new 
instrument, no other researchers have used it in studies. 

Reliability 

Internal consistency reliability coefficients (KR-20's) 
for a portion of the Spring ^1972 Head Start Planned Variation 
sample are listed in Table 1. The KR-20 for the, total sample 
(n = 803) was .203. The estimates for approximately 85 
subsamples with a sample size greater than 20 ranged from 
.021 for older white males with no previous preschool experience 
(n = 62) to .556 for older white males with previous preschool 
experience (n = 26) . Only 10% of the KR-20 estimates were 
reater than ..AO. Most of them were under . 20 and a few were 
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TABLE 1 



KR-2 0 RELIABILITIES 


FOR SPRING 


1972*HSPV RRC 


SCORES 




n 


mean^ 


S.D. 


KR-20 


Total-"- 


03 


8. 824 


2. 20 7 


0.203 


Black 


AS - 


8.662 


2.240 


0.223 


White 


318 


8.865 


2.204 


0 207 


Mexican- 


129 


9.11& 


2.130 


0.156 


American 










Male . _ 


416 


8. "96 4 


2. 179 


0.190 


Female , 


387 


8.674 


2.227 


0.216 


Yount^ - 


322 


8. 770 


2. 199 


0.192 


Old 


. 477 


8. 85 3 


2.209 


• 0:211 


Previous 


192 


8.656 


2.520 


.0.385 


Preschool 










No Previous 


592 


8. 873 


2; 104 


0vl29 


Preschool 









Includes all children with adequate age information not 
in Level I sites. 

2 . 

Maximum score = 16. ■ 
^Young is less than 57 mirths; old is greater than 56 month 
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negative. This random fluctuatioij of estimates around 
zero indicates that there was a great deal of guessing 
occurring on the test. 

Head Start Planned Variation Score Characteristics 

The distribution of the Relevant Redundant Cue Scores 
for. all children in the Spring 1972 sample is presented in 
<iTable 2. The mean score and standard deviation for each 
three month age interval from 36-38 months to 78-80 months 
are included. The mean score for the total sample (n = 799) 
is 8.820 (S.D. = 2.205) . ' 

■The distributions of scores in the spring for all 
planned variation children^ and all non-planned variation 
children are bimodal (see Tables 3 and 4) . These distribu- 
tions may be explained by the fact that rhildren's scores are 
partially determined by guessing and/or by knowing only one of 
the two dimensions of a "zing" or a "poggle". If the children 
were only guessing^ the. scores ..would have been lower. If a 
child knew one of the two dimensions of a "zing" or a "poggle", 
he -would get approximately one-half of the items correct all 
the time. If . the child knew one characteristic (such- as a ,: 
"zing" is green) and guessed on items without that characteristic 
(such as a black rectangle) , he would get^a score slightly 
under or over the mean; 
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TABLE_2 

DlgTRIBUTIOM QF RRC (ZII IGS AFDPOGGLES) PCOlRES 
FOR ALL CHILDREN It! ; THE SPRIIIG 1972 HSPV S.^J^PI.E 



Age (Months) 


N 


2 

Mean Score 


S.D. 


36-38 - 


1 


7.000 




39-41 


1 


11.000 




42-44 


5 


8.200 


1.720 


45-47 


17 


8.235 


1.733 


48-50 


65 


8.938 


2.423 


51-53 


113 


8.823 


2.215 


54-56 


120 


8.725 


2.117 


57-59 - . 


125 


8.704 


2.102 


60-62 


104 


9.096 


1.949 


63-65 


77 


9.026 


2.-^313 


. 66-68 


■ 85 


-8.882 


2.19 8 


69-71 


53 


8.528 ■'■ 


2.270 


72-74 


32 


8.563 » 


2.783 


75-77 


1 


■ .13.000 




78-80 








TOTAL 


799 


8.820 


2.205 



Includes all children v/ith - adequate acjo information 
■ not i;i Level I sites. 



r'aximum score - 16 • 
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Remarks ' ' 

Because there is not yet available technical information 
on ±his instrument from the ETS Longitudinal Study anu only 
a limited a^^stt of information from the Head Start Planned 
Variations Study since ,it v/as only given in the spring, the 
Relevant Redundant Cue Test must be considered as an experi- 
mental instrument in the beginning stages of development. From 
the limited information available, it appears that the test is 
too difficult for young children; perhaps it should only be 
used with older children in future evaluations. 

Re ferences 
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Stai.f ord-Binet Intelligence Scale 

Purpose 

The Stanf ord-Binet Intelligence Scale is admeasure of 
"general intelligence" which is widely used in the United 
States. Although it is called a test of intelligence, it 
is just as much a measure of experience and achievement. 
It is most often defined as a measure of general mental 
adaptability for populations exposed to .gimilar experiences 
It has high predictive validity in terms of future school 
success . 

Description 

The Stanf ord-Binet Intelligence Scale, revised edition 
Form L-M, consists of different subtests graduated in dif- 
ficulty according to age. It is an age scale test based 
on the assumption that general intelligence is a trait that 
develops with age. The primary criteria used in construct- 
ing such a test are that the subtests be arranged in a seal 
so that the mean mental_^age- of unsel-eeted -subjects is the 
same as their jnean chronological age and that the varia- 
bility of IQ scores remains approximately constant from age 
to age. Early subtests (ages 2-3) contain non-verbal tasks 
such as building blocks, the three hole board, and string- 
ing beads. Later subtests have more verbal tasks such as 
vocabulary, analogies, and number problems. A complete 
description of the subtests is in the manual by Terman and 
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Merrill (1960). Basal age is that level at which all tests 
are passed which just precedes the level where the first 
failure occurs. After a child's mental age (MA) is deter- 
mined, it is converted to an IQ estimate using Pinneau's 
revised IQ tables (Terman & Merrill, 1960). Only exper-- 
ienced Binet testers were used in the HSPV Study. 

Development of Instru ment 

The Stanford-Binet was developed by Alfred Binet ±n 
the late 1800 's to identify the mentally defective children 
in the Paris elementary schools. L. Terman published the 
first revision of the original scale in 1916, standardizing 
it for American children, ages 3-16. Terman defined 
Intelligence Quotient as the. ratio of mental age to chrono 
logical age (MA/CA) . In 19 37 Terman and Merrill revised 
the test again, making use of the age standards of perfor- 
mance gathered from the previous test data. At this time 
two forms (L and M) , differing in content but not in type 
of question, were developed. The test was last revised 
in 1960 at which time the two separate forms (L and M) 
were combined. Emphasis was placed on correlation between 
individual subtest items and total score. In selecting 
items for the L~M Form, factor loadings ^f McNemar's 
analysis of the 19 37 revision were taken into account. 
Items were updated and those judged obsolete were replaced 
with more current items. 
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Technical Information 

Much of the reliability and validity of the 1960 scale 

revision rests on the 1937 scale. The 1937 scale has been 

found to be more reliable for older than for younger 'chil- 
li 

dren and for lower than for higher IQ's. At ages 2 1/2 to' 
5 1/2, the reliability coefficients range from ,83 (IQ's 
140-149) to .91 (IQ's 60-69); at ages 6 to 13, .91 (IQ's 
140-149) to .97 (IQ's 60-69); and at ages 14-18, .95 (IQ's 
140-149) to .98 (IQ's 60-69). Since only the most reliable' 
items of the 1937 scale were included in the 1960 revisibn, 
the 1960 scale is at least as reliable as the 19S7 scale 
(Terman & Merrill, 1960);-^ 

Biserial correlations were done for the tests included 
in the L-M form. The mean correlation for the 1960 scale 
is .66, compared with a mean of .61 for aril tests in both 
forms of the 1937 scale. At the preschool level^ (ages 
2 1/2 to. 5) the mean was .61, compared with the 1937 mean 
of .62. Verbal tests have a higher correlation (.65) with 
the total than the non-verbal tests (.58) (Terman & Merrill, 
1960). ' , 

Correlations between retests are high when subjects 
are retested at fairly frequent intervals. In general, 
correlations decrease as interval time is lengthened and 
correlations increase as the child grows older if the interval 
between the two tests is held constant. Data from the 
Pels survey show that the correlation between tests given 
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at age three with retests at age 4 is .83; retest correlations 
with each successive year away from three decrease until 
the correlation at age 12 is .46. (Sontag et al., 1958). 
Test-retest correlations with later ages and age 5 or 6 
are much higher than those with ages under five. For ex- 
ample, Bayley (1949) found that the correlations between 
age 10 and ages 2, 4, 6 and 8 were .42, .73, : 74 , and .82. 

Remarks *' 

Recent questioning of the cultural and socio-economic 
biases in test items has led to a reexamination of the 
validity<^of tests such as the Stanford-Binet . Significant 
questioning and pressures from minority groups resulted in ' 
^omitting the Stanford-Bine t from the 1971-72 battery. Some 
of tlie major areas of concern in considering the use of the 
Stanf ord-Binet and other intelligence tests are listed 



i^^elli 

below ; 



iranaara, 
il^tion. 



1. Standardization on white samples. The Stanford- 
Binet was last standardized on an American white population. 
No standardization figures are available for a non-white 
popu- 

2. Socio-economic status. A number of studies 
(Charters, 1963; Willerman et al. , 1970) have shown that 
children from lower socio-economic backgrounds score lower 
than those from higher socio-economic backgrounds. Specific 
items on the test may be foreign to the particular cultural 
setting of some cnildren. There is no evidence that the 
Stanf ord-Binet is more biased toward lower socio-economic ^ 
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children than other general intelligence tests. 

3, Language. Both Anastasi (1958) and Freeman (19 62^" 
have specif ica.Xly criticized the heavy verbal lo'adings on 
intelligence tests, which may present particular problems 
to lower class children. Verbal tasks on the Stanford- 
Binet are more frequent throughout the older age subtests. 

4, Motivation. 2igler and , Butterf ield (1968) found 
that lack of motivation in culturally deprived children 

led to depressed Stanf ord-B:I.net IQ scores. After a preschool 
-experience a reduction in the dehabilitating faators of 
motivation occurred and IQ scores increased. 

5, Test a(^fministration. Testing younger children is 
especially difficult. The use of non-white testers with 
children of different ethnic backgrounds needs to be further 
investigated. 

While the preceding general problems need to be explored 
further in future studies using all intelligence tests, 
actual biases specific to the Stanf ord-Binet havfe not been 
•documented. ' Even though staricJardization with non-white 
populations and certain revisions in vocabulary and tasks 
seem crucial, the Stanf ord-Binet appears to be one of the 
tjest tests of general individual intellectual assessment'. 
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Wide Range Achievement Test 

Purpose 

The Wide Range Achievement Test (WRAT) is an achieve- 
ment test designed to measure skills in the areas of 
reading, "spelling and arithmetic. Most preschool programs * 
for disadvantaged children emphasize the acquisition of 
*these skills. 

Description « 

The spring '72 form of the WHAT used in the HSPV Study 
is loi^ger than the fall '71 form because most children haA/e 
more cognitive skills after one- year in a Head Start program 
than before. The fall '71 form has' four subtests: copy 
marks, recognizing , and /naming letters, dot counting, and ^ " 
reading numbers. The spring '72 form has eight ^ubtests: 
copy marks, name spelling., recognizing and nait^ing 4(?tters 
spelling, dot counting, reading numbers and arithmetic, 
written arithmetic, and word reading. Descriptions of the 
subtests in the three skill areas follow: 

A. Spelling Skills: 

^* ^^^py"^-^!? rarlis. In a one minofca tinv^*' int^v^p^'^ t^o 
child is to copy as many marks as* possible. 

2. Name Spelling. Part I asks the child to print 

his name in a one minute time interval on a line 

c 

provided. Part II asks the child to name all the 
recognizable letters he has printed. 
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B, Reading Skills; ' 

1, Recognizing and Natning Letters, Part I asks, the 

child to recognize- and match letters. The tester 
** 

. points to a series of letters in the row;, the child 

-» 

picks out the matching letters from a different 
series. Part II *asks the child to read aloud 
the letters in the second row. 

2. Word Reading. The child is asked to, read aloud 

t 

a list of 14 words: ^ cat, see,;red, to, big, 



. work, book, eat, 'was ,^ him, how, the n, open , 

' o . ^ ■ . 

letter'. ' ' ^ ' - . 

C. Arithmetic Skills: ' 

1. Dot Coui>ting\ * T^he child is asked to count dots 
alrran^eji in a row. 

2. Reading Numbers. In a^ one minute time interval 
the child is asked to read aloud the numbers "3, 

^ 5, 6, 17, 41". 

3. Arithmetic. The child is* asked to respond to 
three arithtnetic problems, such as "How many 
cire three apples an'd four apples?" . 

4. • Arithmetic (written computation) In a 30 second 

time interval the child is asked read an 

« ■ t* 

arithme'tic problem and write the answer in the 
* box provided. . j 



ERIC 



390 

Development of Instrument 

^he WRAT was developed in 1940 ; revised in 1946 by 
J, Jastak and S. Bijou (BurOs^ 1»965).; and revised in 1965 
by J.' Jastak, S. Jastak and S. Bijou (Euros, 1972). The 
1965 revised edition was prepared in two forms: Level I 
for ages^S to 12 and Level II for age 12 and over. The 
WRAT used in the HSPV Study is a revised version of the 
Level I 1965 edition. A similar version was used during 
two years of the Follow Through evaluation (1970-72) . 

Norms ' *^ ^ 

Norms for the five subtests given in Fall 1971 are 
available in Tables 1-40. > These tables give the number 
of children, the mean score and the standard deviation for 
each of 15 three--month age intervals (from 36-3 8 months t6 
78-80 months) for the following" groups in the HSPV sample: 
total (Table 1 - Copying Marks, Table 9 - Recognizing 
Letters, Table 17 Naming Letters , Table 25 - Reading 
Numbers, and Table 33 - Dot Counting), males (Table 2 - 
Copying Marks, Table 10 - Recognizing Letters, Table 18 
Naming Letters, Table 26 - Reading Numbers, Tab2e 34 - Dot 
Counting), females ^ (Table 3 - Copying Marks, Table 11 - 
Recognizing Letters, Table 19 - Naming Letters, Table 27 - 
Reading Numbers, Table 35 - Dot Counting), children with 
previous preschool experience (Table 4 - Copying Marks, 
Table 12 - Recognizing Letters, Table 19 ~ Naming Letters, 
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Table 28^ Reading Numbers^ T^ble 36 - Dot Counting) ^children 

with no previous preschool (Table 5 Copying vMarks , Table . 

13 - Recognizing Letters^ Table 21 - N^ing Letters, Table 

29 - Reading Numbers, Table '37 - Dot Counting) / 'White 

children (Table 6 - Copy_ing Mark's, Table 14 - Recognizing 

Letters, Table 22 -.Naming Letters, Table 30 - Reading 
. o . . . ' ■ . ■ ' ■ ". . 

Numbers, Table 38 - Dot Counting) , black children (Table 7 - 

Copying Marks, Table 15/- Recognizing Letters, Table 23'"- 

Naming- Letters, Table 31 - Reading Numbers , Table .39 - Dot 

Counting) and Mexican7American children (Table 8 - Copying 

Marks, Table .16 - Recognizing Letters, Table 24 ,- Naming 

Letters, Table 32 - Reading. Numbers, .Table. 40 - Dot Counting) 

Mean scores for the total Fall 1971 sample on the 
fall subtests were 1.921 {S.D.=2.666) for- Copying Marks, ; : 
6.554 (S.D. =3.205) for Recognizing Letters , 1.195 
{S.D. = 2.632) for Naming Letters,- ;ei3 (S.D; = 1.103) f or - 
Reading Numbers, and: ^.708 (S.D. = 5.294) ^or Dot Counting. 
Scores for the Copying Marks, Recognizing Letters, and J)ot 
^-Counting subtests definitely increased with age while 
•scores of the Naming Letters and Reading Numbers subtests 
improved minimumly vfith age. 
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TABLE -1 



DISTP.I3UTI0:-; OF' \WAT COPYIIIG ^'■JP:-^5 5C0PZS FOR ALL CHILDP-EI] 

in THB FALL lg7I' HSPV SAfPLE "^ 



Age (Months) 


N 


2 

Mean Score 


• S.D. 


^ 36-38 


. 6 


0. 333 


0.745 


39-41 


4 


0.500 


0 . 500 ■ 


42-44 


22 


0.273 . 


0.617 


.45-47 


77 


0.63G 


. 1,643 ■ 


48-50 


262 


0.492 


0.9 84 


51-5 3 


478 


0.705 


1.20 4 


54-55 - 


481 


• • 1.15R ■ 


1.79-3- 


57-59 . 


464 


1.672 


2 . 19 2 


60-62 


379 


2.517 


2.784, 


63-65 


252 , 


2.96 8 


2. 766 


66-6 8 


255 


3.443 


. 3.333 


69-71 


205 


.- 5.317 


3.G31 


72-74 ■ 


87 


4.345 


3.835 


75-77 


■ .5 


4.200 


3.816 ■ 


■ 78-80 • 


■ o 


. , 1. 333 


0.943- . 


TOTAL 


2980 


1.921 


.. 2.660 











^Includes all children with adequate age information 
not in "Level I sites* 

^r.axiipum score ^ 18. . 
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TABLE 2. 



D I S T P IBU TION. OF ':'!?7^'2 COPYING I'/PKS- SCOPE? FOP- ''ALES 

: ■ ■ -J 

IM'?HE FALL 1971 HSPV SM'PLE 



Age (Months) 


• N 


2 

. Mean. Score 


S.D. 


36-38 


"1 










39-41 ; 


1 






42-44 


8 '. 


0.125 


0.331 


45-47. 


46 


0.413 


0.946 


48-50 


■ 132 


0.492 ' 


l'. 04 8 


51-53 


255 


0.612 


1.149 


54-56 


243 


■ 0.. 881 


1.539 


.57-59 


239 


"1.247 


1.772 


,6-0-62- - ■ ■ . 


206 


2.335 


2.7 32 


63-65 . 


il5 


2.374 


2.386 


66-68 . 


137 


- - 2.591 


2. 814 


69-71 


94 . 


3.649 


3.426 


72-74 . 


46 


3.891 


3,789 


75-77 


3 


7.000 


2.160 . 


78-80 


2 


2.000- 




TOTAL 


1528 


1.577 


2. 372 



Includes all children with 
not in Level I sites. 

MaxiTTium score = 18. 



adequate age information 
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TABLE 3 



DISTRIBUTION OF I-7PJ.T GOPYIKC; FAPJCS SCOPjs F.OR FEFP.LES 
I^7 THE FALL 19 71 HSPV SJ^FPLE "*- - 



A rtf^ ( Mrvn "f" H c ^ ■ 


N 
i» . 






. 36-38 


' 5 


0.400 


0 .'800 


39-4i 


3 


0.667 


0.471 


42-44 


.14 


0.357 , , 


. 0.718 


45-47 


"^1 
•J J- 


u • ^ u o 


? 279 


48^0 


130 


.0.492 


0 .914 


51-5 3 


223 


0. 012 


1.257 


54-56 


O 0 O 

^ U ' 


- 1.441 


1.980 


57-59 


225 


2.124 


'2.486 


60-62 


173 ■ 


2.734 


2.828 


63-65 


137 


3.^.67 


2.95 7 


66-68 


118 


4.4 32 


3.604 


69-71 


111 


4.883 


3. 702 


72-74 


41 


■ 4.854 


3. 823 


75-77 


2 






78-80 


1 : 






TOTAL 


1452 _ 


2.284 


2.899 ■ 



Includes all children with adequate age information 
.. not in Level I sites. 

■ » {• 

2 * 

■Maximum score = 18. 
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• ■ . TABLE 4 - • 

. - ■ . ■ ■ ■ 

DIS'^RIBUTIOM-.OF '^^rpjT COPYING F?PJ<S SCOPES FOR ALL CHILDREN WITH 

PPiVIOUS PRESCHOOL EXPERIENCE IN . THE F;\LL 19 71 HSPV SM'PLE"'- 



Age (Months) 


N 


2 

Mean Score ■ 


S.D. , 


36-38 








39-41 








42-44 


2 


1.000 


1.000- - 


45-47 


8 


1.625 


1.867 


4.8-50 


34 


0.971 


1.543' 


51-53 


64 . 


0.70 3 . 


-1.056 


54-56 


62 


• 0.871 


1. 301 


. .5 7-59 


79 


2.39 2 


. 3.128..- 


60-62 


119 


.2.846- - 


"2.750 


6 3-65 — 


98 


2.949 


3.167 


'66-68 


92 


3.554 


3.595 


69-71 


95 


4.526 


3.963 


72-74 


37 


5.189 


4.190 


75-77 ■. 


3 . 


7.000- 


2.160 


78-80 


2 


1.000 


1.000 


TOTAL 


695- 


2.784, 


3.297 



Includes all children with 
not in Level i sites, ' 

Maximum score = 18, 



adequate age information 
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TABLE 5 

DISTRIBUTION OF WHAT COPYING f'-ARKS SCORES FOR ALL CHILDREN 
WITH NO PREVIOUS PRESCHOOL EXPERIENCE 
IN THE FiiLL..1971 HSPV Si^^'I^LE■'■ 



Age (Months)- 


N 


2 

Mean Score 


S.D. 


36-38 


6 ' 


0.333 


0.745 


39-41 


4 


0.500 


0 .-500 


42-44 


19 


0.211 


0.521 


45-47 


68 


0. 529 


1.586 


48-50 


221 


0.403 


0. 827 


51-53 


397 


0.708 


1. 240 


54-56 


405 


1.190 


1. 847 


57-59 


373 


1.507 


1.920 


60-62 


249 


2. 369 


2. 816 


63-65 


146 


2 .966 


2.478 


66-68 


157 


. 3.376 


3. 205 


69-71 


107 


4.047 


3.175 


72-74 


50 


3. 720 


3.418 


75-77 


2 






78-80 


1 


2.000 




TOTAL 


2205 


1.647 


2.377 



Includes all children with adequate age information 
not in Level 1 sites. 

MaximuiT) score = 18. 
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TABLE 6 



DISTRIBUTION OF VPi^T , COPYIt'G. :'.?P1<S SCOPES FOP t-lilTE CHILDPEM 

.1 

• IN THE F;^LL 19 71' HSPV Sj^JTLE 

. ft ; ; : : : ~: ~ 



Age (Months) 


.N 


2 

Mean Scpre 


S.D. 


-36-38 








3y - 4 1 




U . b b / 


(J . 4 /I 


42-44 


8 


; 0.125 


' 0.331 


45-47 • 


32 


/ O.50 0 


0.968-- 


48-50 


93 


0.548 


1.122 


51-53 


183 


0. 798 . 


1.419 


54-56 


212 . 


• 1.311 


1.842 


. 57-59 


187 


1.706 


2.309 . 


60-62 


163 ^ 


■ 2.65 0 


2.851 ■ 


63-65 


94 


2.989 


2.988 - 


66-68 


99 ^ 


3.162 


3.335 


69-71 


.79. 


, 5.025 


■ 3.486 


72-74 


5-1 


4. 824 


4.264 


75-77 


3 


7,000 


2.160 


78->0 

1 


■ 2 ■ 


1.00 0 


1.000 


TOTAL 


1214 . 


2.067 


2.812 



"Includes all children with adequate age information 
not ill Level I. sites, 

Kaximunv score = 18. 
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TABLE 7 



DISTRIBUTIOn OF '■J'RJ'-.T COPYINO FAPKS SCOPES FOR BLACK CHILDP.EM 

■ IN THE FMiL 19 71 HSPV SJ^rPLE"'- 



Age (Months) 


N 


2 

Mean Score 


36-38 


6 


0.333 




1 
± 




42-44 


14 


0. 35 7 


45-47. 


45 


0 . 7 33 


48-50 


140 


0.421 


51-53 


2J.0 


0.571 


54-56 


205 


■ 1.010 


57-59 


193 


1.446 


60-62 


137 


1.825 


63-65 


106 


2. 396 


66-68 


102 


3.167 


69-71 


103 . 


3. 485 


72-74 


34 


3.559 


75-77 


2 




78-80 

1 


1 


2. 000 


TOTAL 


1299 


1.550 



S.D. 



0.745 

0.718 
1.982 
0.854 

0. 950 

1. 778 
1.966 

2. 018 
2. 39S 
3.116 
3.444 
2.932 



2. 309 



Includes all children with adequate ago information 
not in Level I sites. 

I 

'Maximum score = 18. 
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• TABLE 8 

DISTRIBUTION OF ':iTI^.T COPYING SCOP.ES FOP. MEZICAN-j^rEP.ICM-: CHILDREN 

• IN THE FALL 19 71 HSPV S^^rPLE"*- 



Age (Months) 



N 



Mean Score 



S.D. 



36- 


38 


39- 


41 


42- 


44 


45- 


47 


48- 


50 


51- 


53 


54- 


56 


57- 


59 


60- 


62 


63- 


65 


66- 


68 


69- 


71 


72- 


74 


75- 


77 


78- 


80 



TOTAL 



23 
73 
53 
70 
69 
50 
51 
19 



408 



0.783 
0. 836 
1.094 
2.214 
3.174 
4.100 
4. 451 
5.421 



2, 564 



1, 
1, 
1, 
2, 
3, 
2, 
3, 
3. 



140 
250 
640 
461 
189 
744 
339 
345 



2.914 



Includes "all children with ade.quate age information 
not in Level I sites. 



2^, 



^'axiInuIn score = 18, 



ERIC 



400 



TABLE 9 



DISTRIBUTION OF WRAT RECOGNIZING LETTERS. SCORES FOR ALL 
CHILDREN IN THE FALL. 1971 HSPV SAJTLE"'- 



Age (Months) 


N 


p 

Mean Score ' 


S.D. 


36-38 


6 


3.667 


3.6 82 


39-41 


4 


6.750 


1.299 


42-44 


22 


4.455 


3.115 


45-47 


77 


4.286 


3.129 / 


48-50 


262 


5. 172 


3.229 


51-5 3 


478 


5.651 


3.217 


54-56 


481 


6.403 


3. 106 


57-59 


464 


6.547 


3.041 


60-62 


379 


7. 179 


3. 152 


63-65 


252 


7.095 


3. 152 


66-68 


255 


7.745 


2.820 


69-71 


205 


7.780 


3.015 ^ 


72-74 


87 


8.655 


2. 10 0 


75-77 


5 


6.000 


4.517 


78-80 


3 ■ 


6.000 


1.414 


TOTAL 


2980 


6.554 


3.205 



^Includes all children with adequate age in format ion 
not in Level I sites. 

2 

Maximum score - 10 . 



ERLC 



401 



- TABLE 10 



DISTRIBUTION OF WPAT RECOGMIZIixTG LETT E RS SCORES FOR MALES 
( IJi THE FALL 19 71 HSPV SAf'PLE^ 



Age ^onths) 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
fO-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOl-AL 



N 



1 
1 
8 
46 
132 
255 
243 
239 
206 
115 
137 
94 
46 
3 
2 



1528 



Mean Score 



5.J000 
5.12 5 
3.957 

5. 364 
5.443 
6.144 

6. 301 . 
7.175 
6. 800 
7.416 
7.351 
€.674 
9.6671 
7.000 



6.369 



S.D. 



2. 522 
2. 881 
3.222 
3.096 
3.145 
3.113 
2.903 
3. 149 
2. 843 
3.178 
2.001 
0.471 



Includes all children with adequate age information 
not in Level I sites. • " 



2m 



i'aximuin score - 10. 



ERIC 



402 

. J 



TAB.LE 11 



DISTRIBUTION OF WPAT RECOGNIZING LETTERS SCORES FOR FE^^ALES 

■ IN THE FALL 19 71 HSPV SAMPLE"'" 



Age (Months) 


. N 


2 

Mean Score 


S.D. 


36-38 


5 


4.400 


3. 611 


39-41 


■ 3 • 


•7.3 33 


. 0.943 


42-44 




4.071 . . . 


3. 348 


45-47 


31 ^ 


.4.774 


3.405 


48-50 


130 


4.977 • 


3. 224 


51-5 3 


22 3 


-5.888 


3.334 


54-56 


. 238 


• 6.668 


3.042 


. 57-59 


225 


6.80 9 ■ 


2.940 


V 60-62 


173 


7.185 


• 3.041 


63-65 


. 137 


* 7. 34 3 


■ 3.13 3 


66-68 


•118 


8.127- 


■ 2.745 


69-71 


111 


8. 144 


2. 818 


72-74 


41 


8.634 


2 . 20(j 


75-77 


2 


0.500 


0 . 500 


,78-80 


1 


.4.000' 




TOTAL 


1452 


'6.74 9 

■ » 


• .3. 220 



^Includes all children v;ith adequate ago in f ariuat ion 
not in Level I sites. . 

>'aximum score =^ 10 • 



403 



9» t ■ 



TABLE 12 



DISTRIBUTION OF-WjlAT RECOGNIZING LET'3/eRS SCORES FOR ALL CHILDREN 
WITlT'^pfelVIOUS < PRESCHOOL EXPERIENCE 
IN THE FALL 1971 HSPV SAMPLE^ 



Age (Months) 



Mean Score 



S.D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



2 
8 

.34 
64 
62 
79 
119 
98 
92 
95 
37 
3 
2 



695 



8.500 
6.125 
5.706 
6. 375 

6. 581 
7.2 28 

7. 445 
7.449 

8. 185 
8.053 
8. 784 
9.667 
5.500 



7.404 



0 . 5Q0 
3.219 

650 
809 
124 
846 
866 
935 
231 
766 
120 



3, 
2, 
3, 
2, 
2, 
2, 
2, 
2, 
2, 

0. 471 

1. 500 



2. 909 



"Includes all .children v;ith adequate age information 
not in Level I sites. • " • 



'Maximum score '= 10, 




404 



TABLE 13 



GET' 




DISTRIBUTION OF WRi^.T RECOGNIZING SETTERS SCORES FO^ A LL CHILDREN 

7 

WITH NO PREVIOUS PRESCHOOL EXPE^-^ENCE 
■ IN THE FALL. 19 71 HSPV SAJ^.PLE 



Age (Months) 


N 


Mean Score ^ 


S.D. 


36-38 


6 


3.667 


3. 682 


39-41 


4 


6.750 


1. 299 


49 — 4 4 


19 


3.895 


2 972 


45-47 


68 


3.985 


2.983 


48-50 


221 


5. 100 


3. 178 


51-53 


397 


5.547 


3. 247 


54-56 


405 


• 6.410 


3.078 


57-59 


3" 3 


6.378 


3.06 7 


60-62 


24 9 


7.052 


2. 9^3 


63-65 


146 


• 7.137 


3.049 


66-68 


157 


7.592 


2. 956 


69-71 


107 


7, 645 


3.100 


72-74 


50 


8.560 


2 . 080 


75-77 


2 


0.500 


0 . 500 


78-80 


1 


-. 7.00 0 




TOTAL 


2205 


6.32 3 


3. 224 



•Includes all children with adequate age information 
not in Level I sites. 

Maximum scofe=10. 



405 



TABLE 14 

DISTRIBUTION OF \''^PJ^T RECOGITIZIFG LFTTERS FCOPPS ^OR '■'IIITE 



CHILDREN IN THE FM.L 19 7.1 HSPV SAf-'PLE-*- 



Age (Months) 


N 


2 

Mean Score 


S.D.. 


36-38 






r- 


39-41 


3 


7.000 


1.-414 


42-44 


8 


4.750 


2. 586 


45-47 


32 


4.656 


3.058 


48-50 


9 3 


5.323 


3. Ill 


51-53 


183 


5.622 . 


3.135 


54-56 


212 


6.476 


3. 142 


57-59 


187 


6.909 


2. 734 


60-762 


163 


7.485 


2.601 


63-65 


9 4' 


7.628 


2. 621 


66-68 


99 


7.939 


2. 440 


69-71 


79 


8.532 


2.055 


72-74 


51 


8.804 


1.645 


75-77 


-> 

J) 


9.667 


0. 471 


78-80 


2 


5. 500 


1.500 


TOTAL 


1214 


6.846 


2.985 



Includes all children v;ith adequate age information 
not in Level 1 sites. 



tnaximum score=10. 



406 



. ' TABLE 15 

DISTRIBUTION Or" l-'PJ ^ T PECOGNIZI:-^G LETTERv^ SCORES FOR BLACK 
CKILDRE:T in the fall 19 71 HSPV SJ^MP LE^ 



Age (Months) 


N 


2 

Mean Score 


S.D. 


36-38 


6 


3.667 


3.682 


39-41 


^ 1 


6.000 




A 1 A A 


14 


*3 • u O \J 


? IRQ 


45-47 


45 


4.022 


3. 15 2 


48-50 


140 


5.100 


3.332 


51-53 


210 


5.505 


3.256 


54-56 


205 


6.371 


3. 105 


57-59 


19 3 


6.104 


3.19 6 


60-62 


137 


6. 869 


3.073 


6 3-65 


106 


7.264 


2 . 773 


66-68 


102 


7.637 


2 .920 


69-71 


103 


7.757 


2. 951 


72-74 


34 


8.533 


2. 415 


75-77 


2 


0.500 


0.500 


78-80 


1 


7.000 




TOTAL 


1299 


6.322 


3 . 278 



Includes all childrcrv . v/ith adequate age information 
not in Level I sites. 



maximum scorc=10. 



407 



TABLE 16 



DISTRIBUTI0^7 OF VTRRT RFCOGNIZIMG LETTERS SCOPJIS FOR ?^EX ICAN-;^yEP ■ I C;^ M 
CHILDREN IN THE FALL 19 71 HSPV SAMPLE''" 



Age (Months) 


N 


Mean Score ^ 


S.D. 


36-38 








0>T '1 J. 








42-44 








45-47 








48-50 


23 


5. 826 


2. 792 


51-53 


73 


6.068 


3. 215 


54-56 


53 


6. 321 


2. 800 


57-59 


70 


6.786 


3.295 


60-62 


69 


7.014 


3.317 


63-65 


50 


5.620 


4. 204 


66-68 


■ 51 ' 


7.451 


3.263 


69-71 


19 


4. 526 


4.453 


72-74 








75-77 








78-80 








TOTAL ^ 


408 


6.417 


3.458 



Includes children v;ith adequ£ite age information 

not in Level I sites. 



ERIC 



2 

maximum scox*e=10. 



408 



/ 



TABLE 17 

DISTRIBUTION OF WPAT. l^PflllG lETTEP.S SCORES FOR ALL 
CHILDREN IN THE FALL 1971 HSPV SA^'PLE■'" 



Age (Months) 



N 



Mean Scored 



S.D. 



36- 


-38 


39 


-41 


42 


-44 


45 


-47 


48 


-50 


51 


-53 


54 


-56 


57 


-59 


60 


-62 


63 


-65 


66 


-6 8 


69 


-71 


72 


-74 


75 


-77 


78 


-80 



TOTAL 



6 
4 
22 
77 
262 
478 
481 
464 
379 
252 
255 
205 
87 
5 
3 



2980 



0. 318 

1. 013 
0.649 
0.722 

073 
136 
417 
115 
675 
137 
655 



1. 
1, 
1. 
1. 
1, 
2 , 
2, 
0. 800 



li 195 



0.555 
2.535 
736 
017 
540 
5 50 
850 
225 
001 
3.620 
3. 856 
0 .748 



2.632 



"Includes all children with adequate age information 
not in Level I sites. 



^ Maximum s.core=13. 



409 



TABLE 18 

DISTRIBUTIOM OF VIPAT NAMING LETTERS SCORES FOR MRLES 
IN THE FALL 1971 HSPV S^FPLf} 



Age (Months) 



N 



Mean Score 



S.D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



1 
1 
8 
46 
132 
255 
243 
239 
206 
115 
137 
94 
46 
3 
2 



1528 



0.125 
0.783 
0.644 
0.592 
1.037 
0.858 
422 
226 
, 343 
064 
,283 
000 



1, 
1, 
1, 
2, 
2 , 
1, 



0, 
2, 
1, 
1, 
2, 
2, 
3, 
2, 
2, 
3, 
3, 



331 
074 
508 
887 
483 
242 
074 
296 
822 
784 
405 



0.816 



1.080 



2. 550 



"'"Includes all children v;ith adequate age information 
not in Level I sites. 



2 

Maximum score=13. 



ERIC 



410 



TABLE 19 

« 

DISTRIBUTION OF WPJ^.T UM^mC LETTERS SCORES FOR FEMALES 
IN THE FM.,L 1971 HSPV PM'PLE"'- 



Age (Months) 


N 


Mean Score ^ 


S.D. 


'36-38 


5 










39-41 


3 






42-44 


14 


u . 4zy 


0.523 


45-47 


31 


1.35 5 


3.064 


48-50 


130 


0.654 


1.940 


51-53 


223 


0.870 


2.146 


54-56 


238 


1.109 


2.595 


57-59 


225 


1.431 


2.810 


60-62 


173 


1.410 


2.558 


63-65 


137 


1.022 


2.160 


66-68 


118 


2.059 


3.152 


69-71 


111 


2.19 8 


3.474 


72-74 


41 


3.073 


4.268 


75-77 


2 


0.500 


0.500 


78-80 


1 






TOTAL. 


1452 


1. 316 


2.709 



Includes all children v;ith adequate age infoi'mation 
not in Level I sites. 

Maximua scores 13. 



I 



411 



TABLE 20 



DISTRIBUTION OF V^PP.T NANIMG LETTERS SCORES FOP. ALL CHILDPEN 

VJITH PREVIOUS PRESCHOOL EXPERIENCE 

1 

IN THE FALL 19 71 HSPV SA^'PLE 



Age (Months) 



N 



Mean Score 



S. D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



2 
8 

■ 34 
64 
62 
79 

119 
98 
92 
95 
37 
3 
2 



695 



500 
250 
794 
266 
387 
46 8 
2.008 
0 .980 
891 
379 
622 
000 



0, 
2, 
0, 
1, 
1, 
1, 



1, 
2, 
3, 
1, 



1.728 



,550 
,455 
,011 
,763 
672 
,920 
3. 506 
1.985 

2. 928 

3. 787 

4. 277 
0. 816 



0, 
3. 
2. 
2. 
2. 
2. 



3. 134 



■'•Includes all children with adequate age information 
not in Level I sites. 



2, 

FRir 



Q Maximum score=13. 



412 



TABLE 21 



DISTRIBUTION OF WHAT NM!ING LETTERS SCORES FOR ALL CHILDREM 
WITH MO PPJSVIOUS PRESCHOOL EXPERIENCE 



IN THE FALL 19 71 HSPV SAMPLE"^ 



Age (Months) 



N 



Mean Score 



S.D, 



36- 


38 


39- 


41 


42- 


44 


45- 


47 


48- 


50 


51- 


53 


54- 


56 


57- 


59 


60- 


62 


6 3- 


65 


66- 


68 


69- 


■71 


72- 


•74 


75- 


■77 


78- 


■80 



TOTAL 



6 
4 
19 
68 
221 
397 
405 
373 
249 
146 
157 
107 
50 
2 
1 



2205 



0.211 
0f882 
0.624 
0.597 
049 
013 
129 
233 
535 
972 
940 
500 



1.022 



0 .408 
2.380 
1.699 



1< 
2 . 
2. 
2. 
2. 
2. 
3. 
3, 



770 
554 
335 
373 
407 
964 
492 
337 



0.500 



2. 405 



Incluclos all cliildren v.'ith , adequate age information 
net in Level I sites. 



Maximum score = 13. 



413 



TABLE 22 

DISTRIBUTION OF r7R?.T Ni^MING LETTERS SCORES FOR WHITE 
CHILDREN IN THE FALL 19 71 HSPV . SAMPLE''" 



Age (Months) 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



N 



3 
8 
32 
93 
188 
212 
187 
16 3 
94 
99 
79 
51 
3 
2 



1214-^ 



Mean Score^ 



S.D. 



0.500 
1.688 
0.634 



1, 
1. 
1, 
1, 
1. 
2, 
3. 
2, 
1, 



043 
476 
390 
503 
319 
131 
367 
922 
000 



1.552 



0.707 



3, 
1, 
2, 
3, 
2, 
2, 
2, 
3, 
4, 
3, 



025 
664 
667 
136 
853 
872 
586 
541 
401 
814 



0 . 816 



3.083 



Includes .all chi]j3ren with adequate age information 
not in Level I sites. 

2 

' Maximum score =13. 



1 



414 



TABLE 23 

DISTRIBUTION OF WRAT. Nj^^!IMC- LETTERS SCORES FOR BLACKS 
CHILDPJIN IN THE FALL 1971 HSPV SAKPLE^ 



9 





Age (Months) 


N . 


2 

Mean Score 


S.D. 




36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 


6 
1 

14 

45 
140 
210 
205 
193 
137 
106 - 
10 2' 
103 

2' 
1 






< 


0.214 
0.533 
0.71.4 
0 .505 
0 .712 
1.109 
1.438 
. 0.858 
1.382 
1.534 
2.26 5> ' 
0.500 \ 

/ 


-W 

0 .410 
1.9 84 
1.910 
1. 378 
1. 856 
2.418 
2.909 

1. 501 

2. 594 

2. /49 

3. ^950 
0.500 




TOTAL 


1299 


0.968 

/ 


2.26 











Includes all children with ^^dequate age information 
not in Level I sites. 



^ Maximum score = 13. 

ERIC 



415 



TABLE 24 



DISTRIBUTION' OF VIRA.T y^P2'iy.G LETTERS SCOPFS FQR VZXK^N^^P^EP.lCPll 
. CHILDTIEN IN THE FALL 19 71 HSPV... SA^TLE■'■ . ^ 



1 

4 

• 


Age (Months) 




Mean 'S.core 


S.D. 


36-38 








« 










39-41 










42-44 ' 










45-47 










48-50 ' 


23 


• ,0.478 


0 . 878 




.51-53 


' 73 


0.534 


1. 536 




54-56 


5 3'- 


0.565 


0.9 81 




57-59 


70 


0.629 


2.126 ' 




60-62 


69 


0.826 


1.918 




6 3-65 


50 


1.160 


2.533 




66-68 


51 


. \:4.4 3i 


2.553 




69-71 


19 


0.632 


1.563 




72-74 










75-77 










78-80 










TOTAL 


408 


0.794 


1.950 



ERIC 



^Includes ' all childrGn v;ith eidequatG age information 
•.not iii Level I sites. 

^Maximum score =13, • • 



416 



TABLE 25 

CniLDREr: IM TTIE 'gALL 1971 ilSPV SPJ'PLi;^ 



Age (Months) 


N 


Mean Score^ 


S.D. 


JO — .^8 


6 






39-41 


4 


0.250 


0.43J 


42-44 


22 


U . J. J O 


•0.43/ 


45-47 


77 


' 0.325 


0.829 


48-50 


262 


0.271 


0.670 


51-53 


478 


0.299 


0 .724 


54-56. 


" 481 


0.493 


0 .99 3 


57-59 


4G4 • 


0.433 


0 .967 


60-62 


379 


0.734 


1.187 


63-65 


252 


0.742 


1.132 


66-68 


255 


0.973 


1.335 


69-71 


205 


1.312 


■ 1. 335 


72-74 


' B7 = 


1.553 


1. 51 


, 75-77 


5 


0.800 


i.l66 . 


78-80 / 


3 






TOTAL 


2980 


0.613 


> 

1.103 











Includes all children with adequate age information 
not in Level I sites. 

2 • ■ 

Maximum -score = 5. . • 



417 



^1 



TABLE 26 



DISTRIBUTION! 0^vi-»7P.AT- READING I^IUMBERS. SCORES FOR Mi^LES 
•ra THE fall: 19 71 HSPV Si^JTLE"'- 



Age (Months) 



N 



Mean Score 2 



S.D, 



36-38 

39-41' 

42-44 

45-47 

48-50 

51-53 

54-56 

57-59 

60-62 

63-65 

66-68 

69-71 

72-74 

75-77" 

78-80 



TOTAL 



1 
1 
8 
45 
132 
255 
243 
239 
206 
115 
137 
94 
46 
3 
2 



1528 



0.125 
0 . 348 
0.265 
0.. 2«6 
0;539 
0 . 377 
0.748 
0.722 

0. 774 

1. 309 
1.543 
1. 333 



0.580 



0. 331 
0.914 
0 .638 
0. 631 
1.047 
0 . 834 
1.224 
184 
,25.6 
, 414 
,611 
,247 



1, 

1 

1 

1 

1 



1.085 



Includes all chi. ' -en with 
not in Level I sices. 

Maximum score =5. 



adequate age inf otmation 



ERIC 



418 



TABLE 27 



DISTPIBUTIOM CF WPJT RF;^DING IIUfBrP.S SCORES FQP FEF^^^LFS 
•IH THE F;^T.L 1971 IISPV S?!'?LE^ 



Age (Months) 



. N 



Mean Score' 



S.D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
•54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



5 
3 
14 
31 
130 
223 
2 38 
225 
173 
137 
113 
111 
41 
2 
1 



1452 



0.333 
0,143 
0.290 
0.277 
0.314 
0.445 
0.596 
0.717 
0.759 
1.203 
1.315 
1.585 



0.647 




0.471 
0.515 
0.681 
0.702 
0 . 769 
0.932 
1.079 

: ,141 

387 
1.401 
1.481 



1, 
1, 



1.121 



Includes all children with adequate age information 
not in Level I sites. 



ERIC 



Maximum score = S. 



419 



TABLE 28 

DISTPIBUTION OF I-^PJ.T READING MUyBE^S SCORE?; FOP ALL CHILDPPN 
V7ITH PP.EVIOUS PRESCHOOL EXPERIENCE 
IN THE F?L1, 1971 HSPV SAr-TLF^ 



Age (Months) 


N 


Mean Score ^ 


S.D. 


36-38 








hi. 








42-44 


2 


1.500 


0.500 


45-47 


8 


1.125 


1.053 


48-50 


34 


0.324 


0.629 


51-53 


64 


0.438 


0.916 


54-56 


62 


0.661 


1.062 


57-59 


79 


0.557 


1.076 


60-62 


119 


0.924 


1.291 


63-65 


98 


0.776 


1.093 


66-68 


92 


1.109 


1. 363 


69-71 


95 


1 . 29 5 


1. 368 


72-74 


37 


2.081 


1.583 


75-77 


3 


1. 333 


1.247 


78-80 


2 














TOTAL 


695 


■ 0.904 


1.265 



'Includes all children with 
not in Level I sites • 

[ 

Maximum score = 5. 



adequate age information 
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TABLE 29 



DISTRIBUTION OF \'1PAT READING MUr.BERS SCORES FOR ALL CHILDREN 
WITH NO PREVIOUS PRESCHOOL EXPERIENCE 
IN THE FALL 1971 HSPV SAl'PLE^ 



Age (Months) 



N 



Mean Score 



S.D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
5 7-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



4 
19 
68 
221 
397 
405 
373 
249 
146 
157 
107 
50 
2 
1 



0 , 250 

0.235 
0.267 
0 ,290 
0. 472 
0.456 
0.659 
0.719 

0. 904 

1. 355 
1, 180 



0 .529 



0.433 

0.750 
0.684 
0.698 
0.987 
0 .927 
134 
232 
305 
449 
410 



1. 

1, 
1. 
1. 
1. 



1.036 



Includes all children with adequate age information 
not in Level I sites. 



2 

Maximum score = 5. 
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TABLE 30 



. DISTRIBUTION OF V7PAT READING KW.BERS SCORES FOR V7HITE 
CHILDREN IN THE FJML 1971 HSPV SM^PLE-"- 



V 



Age (Months) 



N 



Mean Score 



S.D, 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



3 
8 
32 
93 
18 8 
212 
187 
163 
94 
99 
79 
51 
3 
2 



1214 



0.333 

0. 375 
0. 312 
0 .330 
0.571 
0.572 
0.920 

0. 798 

1. 202 
1. 734 
1.6G6 
1.333 



0. 744 



0. 471 

0.927 
0. 816 
0 . 770 
1.103 
1.028 



1, 
1, 
1, 
1, 
1, 



306 
190 
400 
482 
627 



1.247 



1.217 



Includes all children with adequate age information 
not in Level I sites. 

) 

'Maximum score =5. 
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- TABLE 51 

DISTRIBUTION OF WRAT READING NUMBERS SCORES F^OP. BLi^CK 
CHILDREN IN 'THE FALL 1971 HSPV Si^-^PLE^ 



Age (Months) 



N 



Mean Score 



S.D. 



36-38 
39-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
6 3-65 
66-68 
69-71 
72-74 
75-77 
78-80 



TOTAL 



6 
1 
14 
45 
140 
210 
205 
193 
137 
106 
102 
10 3 
34 
2 
1 



1299 



0.214 
0.289 
0.271 
0.276 
0.415 
0 .466 
0.577 
0.509 

0. 725 
1.039 

1. 382 



0.499 



0.558 
0.749 
0 .596 
0.669 
0. 860 
0.982 
1.065 
0.934 
1.181 
277 
415 



1, 
1. 



0.971 



^Includes all children with adequate age information 
not in Level I sites. 



2 

Maximum score = 5. 
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TABLE 52 

DISTRIBUTION OF WRAT READING NUMBERS SCORES FOP. MEXICAN -AMERICAN 
CHILDREN IN THE FALL 19 71 HSPV .WPLE^ 



Age (Months) 


N 


Mean Score ^ 


S.D. 


36-38 
39-41 

45-47 




















48-50 


23 


0.174 


0.480 


51-53 


73 


0. 315 


0.774 


54-56 


53 


0.453 


0.943 


57-59 


70 


0.300 


0.744 


60-62 


69 


0.580 


0.999 


63-65 


50 - 


1. 040 


1.442 " 


66-68 


51 


1.000 


1. 372 


69-71 


19 


1.105 


1. 372 


72-74 








75-77 








78-80 








TOTAL 


408 


0.578 


1.084 



•^Includes all children with adequate age information 
not in Level I sites. 

2 

Maximum score = 5, 



ERIC 
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TABLE 33 



DISTRIBUTION OF^ WRAT DOT COUNfTI^G SCORES 

■ ■ ■ ,. ■ . \ ] 

FOR ALL CHILDREN IN THE FALL 1971 HSPV SAMPLE 



Age (Months) 



N 



39-41 
42-44 
4[i-47 
4 8-50 
51-5 3 
54-56 
57-59 
60-62 
63-6 5 
66-68 
69-71 
72-74 
75-77 
78-80 



tot;^,l. 



. 4 
22 
■ 77 
262 
478 
481 , 
464' 
3,79 
252 
255 
205 
87 
, 5 
3 



2974 



2, 
2, 
3, 
4, 
4, 
5, 
6, 



000 
455 
714 
050 
360 
699 
349 
8.024 
8.794 
9.596 
10.4.44 
10.138 
5.600 
5.333 



6.708 



S. D. 



3 
4 

'.-4 
,4 
5 
5 
5 
5 
■ -4 
4 
5 
4 
6 



707 
,299 
360 
336 
403 
048 
019 
112 
009 



832 
052 
499 
182 



1 5.294 



"ERIC 



1 



2 



Includes all clijj.drqn v;;i. tli cidocjuate age information 
riot, in Lovcol X sites. 

Maximum score =15. 
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TABLE 34 ^ 

— ■ W 

DISTRIBUTION OF WHAT DOT COUNTING SCORES 
. FOR MALE IN THE FALL 1971 HSPV SAMPLE"'- 



• A.c}<3 ( lion t h 5 ) 


N 


2 

Mo cl3"l SCOiTt? 


S . D . 


39-41 


1 


- 1.000 




42-44 


.8 


.875 


1.053 


'1 O - 0 / 


4 D 


J • ^ X J 


A AOC, 


4 8-50 • 


132 


4.182 . 


4 .627 


51-53 


255 


3.847 


, 4.142 


54-56 


243 


5.078 


4.878 


57-59 


239, 


5.527 


4.669 


60-62 


.. 206 


,7.850 


5.169 


63-65 


115 


8.148 


5.166 


66-68 


137 . 


8.642 


4.927 


69-71 


94 


9.638 


4.935 


72-74 


46 


9.109 


5.301 


75-77 


3 


9.000 


2.160 


78-80. 


2 


8.000; 


6.000 


TOTi'^L 


1527 


6.144 


5.175 



•''Includes cill children v/itli adequate i^cjc information 
not in 3y:ivel I sites. 

^Maximum score = 15, ' » 

.... ■ . . ■ ■ ■■ : ■■■ ■ 
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TABLE 35 

DISTRIBUTION OF WRAT DOT COUNTING SCORES 
^ FOR FEMALES IN THE FALL 1971 HSPV SAMPLE"^ 



Acje (Months) 


N 


2 

MocUi Score 


S.D. 


39-41 


3 


2.333 


.471 


42-44 


■ 14 


3.357 


3 .772 


45-47 . 


31 


3.419 


4.133 


• 48-50 


130 


3.915. 


4.015 


51-§3 


2 23 


4.946 


, 4; 614 


5-4-56 


238 


6.332 


5.139 


■ 57-59 


225 


7.222 


5.227 


60-62 


173 


8.231 


5.034 


63-65 


137 - 


9.336 


4 .808 


66-68. 


118 


10.703 


4.589 


69-71 


.111 


11.126 


4 .635 


72-74 


41 


- 11.293 


4.484 


75-77 


2 


.500 


.500 


..28-80 


1 






TOT'hL 


14 97 


7.304' 


5.353 



Inc-luclGG all . chilf.l}:on v;ith ciclcicjuato ncjc- inform: 
• not in Level I\ si to 53*. 

2 ■ 

' Maximum score = 15. ■ * 

ERIC \ 
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TABLE 36 



STRIBUTION OF WRAT DOT COUNTING -SCORES 



FOR ALL CHILDREN WITH PREVIOUS PRESCHOOL 
EXPERIENCE IN THE FALL 1971 HSPV SAMPLE""" 



Age (Months) 



N 



Moan Score 



35-41 
42-44 
45-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
.66-5 8 
69-71 
72-74 
75-77 
78-80 



IrOT^^L 



2 . 


5.500 


8 


5.875 


34 


5.324 


64 


5.375 


62, 


5.758 


79 


8.038 


119 


9.126 


98 


5.204 


92 


10.717 


95 


10.968 


37 


11.865 


3 


9.000 


2 


1.000 


695 


8.718 



4 . 500 
5.55d\ 
5.132 
4.827 
5.148 
5.232 
4.965 
863 
.507 
.644 
134 
160 



4 
4 
4 

4 
2 

1,000 



5.290 



■ ' . ; ■ ■ ■ '-"^ 

■'■Includes all children v.'ith atlequate acjo' in f orin;{tion 
not in Level I- sites w 

o/ ... ■ . 

Maximum score =- 15. 
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^ TABLE 37 
DISTRIBUTION OF WRAT DOT COUNTING SCORES FOR 
ALL CHILDREN WITH NO PREVIOUS PRESCHOOL 
'experience IN THE FALL 1971- HSPV SAMPLE''' 



Age (Mcinths ) . 


N . 


Meein Score2 


S. D. 


39-41 
42-44 • 
45-47 
48-50 
51-53 
54-56' 
57-59 
GO -6 2 
63-65 ' ' 
66-68' 
69-71 
72-74 
75-77 
.78-80 


19 
68 
221 
397„^ 
405 ^ 
373 
249 
146 
■ 157 
. 107 
5.0 
2 

- 1 


. 2.000 
2.158 
3.368 
3,891 
4.19.1 
5. ,716 
• 5. 95-4 ■ 
. 7.462 
8.342 , 
9.064 
10.093 
8.86 0 
.500 
14.000. 


- ■ .707 
•3.065 
4.080 
4.201 . 
, 4.297 
5.077- 
, 4.896 
5.120 
5. 108 
4.919 . 
4.850 
^5.284 
.500 


_ T0T'7\L 


2199 


. / 
6.082 


5.146 


\. 









*3,nc3.uclos all chilfJren v;ith adequate acjo inforiuat ion 
/ not \n .Lcvol I silcs, ' ^ ■ 

Maximum score = 15. 



TABLE 38 



DISTRIBUTION OF WRAT DOT COUNTING SCORES 
FOR WHITE CHILDREN IN THE FALL 1971 HSPV SAMPLE" 



Age (Months) 



39.-41 

45-47 
48-50 
51-53 
54-56 
57-59 
60-02 
63-65 
66-68 
69-71 
72-74 
75-77 
, 78-80 



.TCrAL 



^3 



3 
8 

■ 32 
' 93 
188 
212 
187 
163 
94 
99 
79 
51 
3 
2 



L214 



Moiin Score 



4 

5 

.5, 
7, 



2.000 
2.250 
4.156 
4.118 
,340 
,297 
,861 
,908 
8.074 
9.293 
10 ."722 
10 .118 
9 . 000 
1.000 



6.536 - 



S . D . 



.816 
3.455 
4.658 
093 
506 
001. 
832 
178 
068 
109 
698 
910 
160. 
000 



5.280 



Includos all cln.ld.i;eM wiUi adoquatc acje information 
not in Laval I sitos. 
Maximum s^core = 15. 



430 



TABLE' 39 

DISTRIBt?TION OF WRAT COPYING K\RKS SCORE^ 
FOR BLACK CHILDREN IN THE FALL 1971 HSPV SAMPLE" 



-Age (Months) 



N 



Moan Scor 



S.D. 



39-41 
42-44 
^5-47 
48-50 
51-53 
54-56 
57-59 
60-62 
63-65 
66-5 8 
69-71 
72-74 
75-77 
78-80 



TCmL 



■ 1 
14 
45 

140 
210 
205- 
193 
■ 137 
.106 
"102 

10 is 

34 
2 
1 



1293 



2.000 
2.571 



3, 
4, 
4, 

6, 
6. 



,400 
,186 
,414 
,098 
,839 
8.XB2 
8,991 
0.088 
10.243 
■10.294 
.500, 
14.000 



6 - 804 



3.201 
4M06 
4 .607 
4.416 
5.194 
5.222 
4.863 
•4.-759 
4^655 
4.900 
5.096' 
.500 



5.324 



I 



Includes all childroii v.'i,bh- 
not ill Lovol J sitps. 

"Maxiraum score 15. 



ciclequato a'cje inf drr.int ion 



ERIC 
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I 

* TABLE 40 



DISTRIBUTION 'OF WRAT DOT COUNTING SCORES FOR 
-- MEXICAN-AMERICAN CHILDREN IN THE FALL 1971 

HSPV' SAMPLE 



^ Arjc (Men ths ) 


N 


Mean Score 


S . D . 


■ 

39-41 










42-44 










45-47 










48-50 


23 




3.4 35 


3.411 


51-53 


73 




4.507. 


4.188 


54-56 


53 




' 5.377 


4.594 


57-59 


70 




6.429 


4.795 


60-62 


69 




7.899 


„ 5.344 


"63--6 5 


50 




9.560 - 


5.258 


66-6 8 


51 




9.039 


4.867 


69-71 


19 




10.316 


5.242 


72-74 










75-77 










78-80 












408 




6. 919 


5.208 



"include*:^ al] chi.l dj:on v;il}i aclocjuatc acjo in ^oi'inriUion 
.i^Maximum score =15.. 

ERIC 
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Score Characteristics 

Frequency distributions of the total scores fqr the 

/ 

five Fall 1971 VTRAT subtests are presented in Tables 41 - 45 

V / 

for the total HSPV sample. The distribution of sco/res of 

■ ' ' / 

the Copying Marks subtest has a definite floor effect, 

/ 

■ / . 

(See Table 41) . Forty-four percent of the children (n^=3033) 

A 

copied no marks correctly and 16% copied only one correctly. 
The distribution of scores/ for Recognizing Letters, a 
matching test, is rather flat across all scores _from 0 to 
10 (see Table 42) . The lairgest number of children (22%) 
scored the highest score. In the spring, this subtest' hAd a 
definite ceiling effect.' The distribution "bf scores for 
Naming Letters has a definite floor effect lA the fall (see 

Table 43). Sixty-fpur percent of the children (n=3033) got 

I / . 

no letters correct, while 15.6% named one /correctly.. The 

! / ■ ' ' . 

Reading Numbers subtesi distribution of scores is also very 

positively skewed (see |Table 44) . Seventy-one percent of 

the children (n=3033) received scores of zero, while 11.4% 

received scores of one. \It should be pointed out . that the 

\ 

Reading Numbers subtest spores do not necessarily form a 

uniform scale since the first three numbers aire sinale 

digit numbv3rs and considerably, easier /to read tha^l the 

♦ . \ ■ ' 

last two numbers which are two^-digit numbers. The Dot 

Counting scores from a bimodq.L distribution -with each of 

the end scores being the m^ost^ frequently obtained (12%) 

(See Table» 45) . The. scores of ^his subtest do not 

represent -a .true continuous scale since the subtest 

consists of only one item score^ from 0 - 15: the total 
O \ I . - ' 

ERJCpre is not the result of scorefe on 15 separate items. ^ 
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TABLE 41 



DISTRIBUTION OF WRAT COPYING MARKS 



SCORES FOR FALL 1971 HSPV TOTAL SAMPLE 



# Of 

Score Children x = nearest 100 children 



0 


1338 


xxxxxxxxxxxxx 


1 


482 


xxxxx 


2 


313 


XXX 


3 


269 


XXX 


4 


233 


XX 


5 


125 


X 


6 


76 


X 


7 


56 


X 


8 


37 




9 


27 




10 


25 




11 


14 




12 


10 




13 


10 




14 


8 




15 


4 




16 


1 




17 


> 




1%!/ • 


2 





Total N -3033 



Includes PV & non-PV children 



I 
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Reliability 

KR-20 reliability coefficients for four of the five 
Fall subtests are reported in Tables 46 - 49 for the total 
sample (n=3205) and nine subsamples . They were not computed 
for the Dot Counting subtest since this is essentially a 
one item test. The KR-20 for the Copying Marks subtest was 
.794 for the total sample (see Table 46). The estimates for 
91 subsamples with a size greater than 20 ranged from .462 
for young black males with previous preschool experience 
(n = 47) to .848 for white females with previous preschool 
experience (n = 135) and for old white males with previous 
preschool experience (n - 94) . Twenty-two percent of the 
KR-20 's were greater than .80; one-half were in the .70 's. 
The KR-20 for the Recognizing Letters subtest was .794 for 
the total sample (see Table 47) . The estimates for 91 
subsamples with a size greater than 20 ranged from .69 6 for 
young female Mexican-American children with no previous 
preschool experience (n = fO) to .854 for old Mexican- 
American females (n = 130) . Almost all of the estimates were 
from .70 to .85. The KR-20 for the Naming Letters subtest 
was .848 for the total sample (see Table 48). The estimates 
for 91 subsaiiiples v;ith a size greater than 20 ranged from 
.376 for young female Mexican- American children with no 
previous preschool experience (n = 60) to .902 for young 
v.'hite males with previous preschool experience (n = 34) . 
Eighty-eight percent of thei.^KR-20 ' s were greater than .80. 
The KR-2sO for the Reading Numbers subtest was .593 for 'the' 
total sample (see Table 49) . The estimates for 91 Gubsamiples 
with a size greater than 20 ranged from .456 for young 




black females with no previous preschool experience (n = 296) 
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to .699 for Mexican-American males with previous preschool 
experience (n = 33). About one-third of the KR-20's were 
greater than .60. 

KR-20's for four of the subtests given only in the 
spring battery (Spelling, Oral Arithmetic, Written 
Arithmetic, Word Reading) are presented in Table 50 for the 
total saiTtple, males and females. Since these KR-20's are 
computed on the spring sanvple after the HSPV treatment was 
introduced, they can not be compared to the KR-20's 
reported for the fall subtests. 
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TABLE 46 

KR-20 RELIABILITIES FOR FALL 1971 COPYING MARKS 
SUBTEST-WRAT SCORES 





n 


2 

mean 


S . D . 


KR-20 


1 

Total 


3205 


1. 899 


2.647 


.794 


Black 


1392 


1.527 


2.298 


.774 


White 


1301 


2.045 


2.793 


.80 2 


Mexican- 


446 


2.534 


2 . 883 


.790 


American 










Male 


1596 


1.571 


2.374 


.780 . 


Female 


1525 


2.257 


2.896 


. 804 


Young ^ 


1416 


0.817 


1.469 


.678 


Old 


1684 


2. 814 


3.059 


.797 


Previous 


751 


2.746 


3 .272 


.821 


Preschool 










No Previous 


2371 


1. 624 


2.357 


.773 


Preschool 










1 

Includes all children with adequate 


age information 


not in Level 



1 sites. 

2 " 
Maximum score =18. 

3 

Young is less than 57 months; old is greater than 56 months. 
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TABLE 47 

KR-20 RELIABILITIES FOR FALL 1971 RECOGNIZING 
LETTERS SUBTEST-V7RAT SCORES 





n 


z 

mean 


s .b. 


KR-20 


Total-"- 


3205 


6,. 467 


3.244 


.794 


Black 


1392^ 


6. 230 


3.306 


.-796 


White 


1301 


6.729 


3.076 


.781 


Mexican- 


446 


6.453 


3.403 


.811 


American . , 










Male 


1596 


6.330 


3.196 


.785 


Female 


1525 


6.655 


3.263 


.801 


Young 


1416 


, 5.638 


3 .268 


.784 


Old 


1684 


7.200 


3.034 


.791 


Previous 


751 


7.388 


2.892 


.780 


Preschool 










No Previous 


2371 


6.205 


3.276 


.792, 


Preschool 











Includes all children with adequate age information not in Level 
I sites. 



Maxiip.um score 



10 



Young is less than 57 months; old is greater than 56 months 



1 



ERIC 



442 



TABLE 4 8 

KR-2Q RELIABILITIES FOR FALL 1971 NAMING LETTERS 
SUBTEST-WRAT SCORES 





- n 


2 

mean 


S .D. 


KR-20 


1 

Total 


3205 


1.204 


2. 642 


. 848 


Black 


1392 


. 978 


2 .290 


. 832 


White 


1301 


1.548 


3.063 


. 860 


Mexican- 


446 


0. 872 


2.116 


.825 


American 










Male 


1596 


1.104 


2.57 6 


. 852 


Female 


1525 


1. 323 


2.723 


.845 


Young 


1416 


0.854 


2.217 


.841 


Old 


1684 


1.506 


2.929 


. 850 


Previous 


751 


1.758 


3.15 8 - 


. 853 


Preschool 










No Previous 


2371 


1. 024 


2.411 


. 842 


: Preschool 











l^ncludes all .children with, adequate age information not in Level 
I sitesu 

Maximum score =13. 

3 ' 

Young IS less than 57 months; old is greater tnan 56 months. 
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TAB LE 4 9 

KR-20 RELIABILITIES FOR FALL 1971 READING NUMBERS 
SUBTEST-WRAT SCORES 





' n 


2' 

mean 


S .D. 


KR-20 


Total-"- 


3205 


0.604 


1.098 


.593 


Black 


1392 


0.488 ^ 


0.965 


.558 


White 


1301 


0.736 


1.213 '. 


.612 


Mexi can*- 


446 


0.574 


1.081 


* .596 . 


American 










Male 


1596 


0.578 


1.085 


. .5.96 


Female- 


1525 


0.640 


l.llP 


.591 


Young 


1416 


0.360 


0.828' 


-.537 


Old 


.16 84 


0.818 


1.249 


. .60 7 ' 


Previous 


751 


0.908 


1.271 


■-.595 


Preschool 










No Previous 


^ 2371 


0.515 -. 


1.025 


.588 „ 


Prp»c;r:hool 











1 ' ' ^ ■ ■ \ 

Includes all children with adequate information not iri*'Level 
I sites • 



Maximum score 



5. 



Young is less than 57 months; old is greater th^n 56 months. 
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TABLE 50 

KR-2Q RELIABILITIES FOR SPRING 19 72 WRAT 
,SUBTESTS^FOR TOTAL HSPV SAMPLE, MALE^AND FEMALES'^ 



sample 



n 



mean score 



S.D. 



KR-20 



A. " SpellincT (Maximum Score 
Total- 2792 .116 
Male - ' ' ■ .J.411 .099 
Female ' . loo .13 3 



= 8) 



.626 
.585 
.664' 



.712 
.719 
.707 



B. Oral Arithmeti c (Maximum Score = '7) 

Total ' ■ 2792 2.320 1.660 

V 

Male 1411 2.327 1.684 

« 

f'emale - . 1381 2.312 1.635 



.550 
.557 
. 544 



C, Written Arithmetic (Maximum Scors = 4) 
Total 2792 .078 .388 

Male ■ 1411 .060 .355 

Female 1381 .0^*^ .419 



499 

534 
':'74 



D. Wor d- Re ading (Maximum Score = 15) 

' ^ ; *• 

Total " 2792 ° .078 .388 

Male " 1411 .060 .355 

Female 1381 .096 .419 



499 

534 
474 



These' subtests v.'ere only given in Spring 1972 . 
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Validity 

Almost all of the studies using the WHAT deal with 
populations which are not comparable with the HSPV sample, 
One exception is a study by "Washington & Teska (1970) in 
which they individually administered the WRAT, ITPA, 
California Achievement Tests (CAT) Primary Forms/ and the 
Stanfcrd-'Binet to 96 disadvantaged children (ages 5*7 to 
7-5, mean age = 6-9) . Pearsonian correlations of the WRAT 
with ^he CAT are listed below: 



CAT 

Reading 


. Reading 
.86 


WRAT 
Spelling 

.82 


Arithmetic 
.72 


Arithmetic 


.87 


.82 


.84 


Language 


.80 


.84 


.69 


Total 


.89 


.87 


.79 



These high correlations are evidence of gooc concurrent 
validity for the WRAT* Cojcrelat ions with tne Star ord-Binet 
and ITPA Verbal ITxpression Subtest are listed b 

' Stanfox'd-Binet ITPA 



WRAT MA ^ 10 Ver. E.^p, Total 

Reading .74 .46 .38 .72 

Spelling * .77 .J7 ' .37 .71 

Ari-hmctic .70 ' .41 .31 .68 
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The interjcorrelations of the. five WRAT subtests 
given in Fall 1971 and the correlations of these subtests 
with other, tests in the Fall 1971 battery are given in' 
frable 51, The intercorrelations between these subtests 
ranged from .302 for Naming Letter^ and Recognizing 
letters to .600 for Reading Numbers and Naming Letters. 
Some of the highest correlations . between a WRAT subtest 
and other tests were .620 (Dot Counting and ETS Enumeration 
Counting), .589 (Dot -Counting and '1:h3 32-itemPSI), .542 
(Dot Counting and ETS Enumeration Total) , .537 (Recognizing 
Letters and the P^^VT!/, .551 (Copying riarks and'the 32-item 
PSI) , .508 (Copying Marks and the ETS Eniimeration Total), •508 
(Reading Numbers and the 32-itcm PSI) , .504 (Copying Marks 
and the ETS Enumeration Counting Subtest) , and .500 (Reading 
Numbers and the ETS Enumeration Counting Subtest)* 'Correla- 
tions between the various WRAT subtests and the ITPA Verbal 
Expression S\±)test were around .30, and thus similar to the 
Washington and Teska (1970) findings. 

• All of the subtests correlated in the .40 - .50 range 

9- 

with the other achievement measure in the battery (32-item 
PSI) : .55-Copying Marks 48-;Recognizing Letters, 41-Naming 
Letters, and .51-Reading Numbers. If the correlations are 
corrected for unrelicibility^ , the estimated correlation 
between the true score components* of the 32-it.em PSI and 
these WRAT subtests are higher: .7-"Copying Harks, .6- 
Recognizing Letters, .5-Naming Letters, and .7-Reading Numbers. 

1 r-i ^5 

Using — ' ■ where r^^ 2 correlation between 

o vr^'^2 

ERJ[Ctcsts and ^1^^2 reliability estimates for the tests. 
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Remarks 

Many of the WRAT subtests appear to be too difficult 
for young children. Even though some of the internal 
consistency reliabilities are adequate for subtests of 
this lengthy the skewed distribution of most subtest 
scores limits the usefulness of this data* Technical 
information is still needed on the subtests used only in 
the Spring 1972; this w^s not calculated for the HSPV 
data since the results would be confounded by treatment 
effects and could not be compared to similar estimates 
for the Fail subtests. Because of these problems, it is 
recorjnended that the WRAT subtests be used only as a set 
of criterion-reference measures. 

Several other questions need to be explored also in 
future analyses using the WRAT: 

1. Why are ^ the subtests timed? Is speed really 
important, especially for younger children? It is clear 
that the time constraints would bo a disadvantage to the 
youngest childrtin in the HSPV sajnplo. 

2. Are the instructicns truly standardized? Since 
there is such a wide variety of subtests, it is not 
certain whether all testers give every item in a standard 
way. In addition, there arc the recurrent probloijis in 
test administration with youn'^cr children of prortipt i ng , ' 
verbal reinforcement, and gestural cueing. 

3. Is the Copying Marks subtest more a laeasurt of 
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motor coordination than achievement especiaxly when used 
with younger children? 

4. Should more attention be placed on individual 
children's response styles in addition to correct 
responses? 

5. Is there a meaningful way to aggregate scores 
across subtests to produce one composite achievement score? 
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• APPENDIX A 
Test-Retest / Inter-Tester Reliability Study 

Introduction 

There are two important issues which this reliability 
study has taken under consideration: 1) the estimation 
of test stability (i*G., test-rete^t reliability), and 
2) the assessment of inter-tester effects for those cle- 
..lents of the HSPV battery where there is reason to suspect 
that the tester may have an important effect on child 
performance. The first pi^ce of information is useful 
for two reasons: 1) it is evidence on which to decidf^ 
whether a particular test should be used in subsequent 
"proyrom-ef fects " analysis, and 2) if it is used for such 
a purpose, it provides reJ lability estimates which are 
necf?i;sary fc>r estimatiiKj true scores. As for the second 
pieci* c>f information, in any test v;hich rcciuires a 
significant a:nc»unt of intt-ract ic>n between the t<!.str^r 
and th(.' ti^st Sv^^K^ct, the ob j(?ct iv i ty and r-xpc^rtise c :" 
the testi..'!' bucc^nio very important. Thii:; ^.s particuLti ly 
jiaport^ant v.hcn testers are nested v.ithir< sites, and v;hen 
the trai.MiJij of tJiosj testers i alj^o nested within sites* 
This is the case in the MSPV evaluation. Any tester 
biases (i. e., "level effects") become completely co!.~ 
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founded with site effects, and could render the interpre- 
tation of such site and model effects impob -xble. 



Design 

The experiment was conducted at two sites (209, 
Salt Lake; and 2C01^ Kansas City), with three testers, 
two par aprof essionals and one expert, at each site. The 
test battery was to be administered twice to each child 
according to the following design on tester assignment: 

FIGURE 1 
TIME 1 





PPI 


■ PP2 


E 




PPI 


pn 

'-*n ' 


11 


" 0 


22 


TIME 2 PP2 




11 


11 


■ 33 
1 


E 


i_ 




15 


26 




33 


22 


26 


81 



This design was to be implemented by SRI at both the 
Salt Lake and Kansas City sites. 

The classc^s were to be chosen at raadoia from those 
available to ^'^''^^ up the 81 cln Idren/si tc . Those 
chiilclren were to be ciosianed at raridcjjn- to the 7 cells 
of the design. 



329 individual test bat^^ries were forwarded to us by 
SR ' • Of tfios.', 33 v;erc totally unusable- (i.e., no 
data, missing identification fields, etc.)* OL the 
^ rer.aining 296 there were 136 usable test pairs (the 
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remaii .ig 24 were missing one of the two observations). 
Of these, 7 had one or more incomplete test codes. 
The remaining 129 units were used in all analyses, 
with the exception of the tr -^t'-retest correlation"* 
which may be based on a slighv. ly higher number (136 = 
n.ax.). The breakdown of these lz9 units is as follows: 



FIGURE 3 

Salt. Lake City Kansas City 





PPI 


PP2 


El 






PP3 


PP4 


F,2 




PPI 


8 


11 


0 


19 


PP3 


11 


7 


0 


18 


PP2 


10 


8 


IP 


28 ' 


PP4 


6 


10 


9 


25 


El 


11 


0 


13 


24 


E2 


• 9 


0 


6 


15 




29 


19 


23 


71 




26 


17 


15 


58 



Analysis ; 

The datv wore analyzed n's a repeated measures model v;i th 
Grouj.'s , i.e., tester |\airiiKj (a fixed effect) nested v/ithin site*^.. 
An rnweiahteJ Mc^ans Analysis using the Datatext, 
Release 3 program and an exact least-squares analysis 
using Mu 1 ti.var iance , Version 4 were performed. The 
results v.'cre thoroughly consistent. Table l^contains 
the ANOVA tables for the Unweighted Means Analysis. 
Tlie means and standard devi itions on each of the tests 
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UNIS'EIGm'ED NEAXS ANALYSIS OF VARIANCE TABLE 
Groups within Sites Repeated Measures Model 



CLASSIFYING FACTORS 

SITE SITE 
GROUP GROUP 
TIME TEST TIME 

- UNIT SUBJECTS OR UNITS OF ANALYSIS 



SOURCE 

SITE 

GROUP 

UNIT 

TIME 

SITE X TINfF. J 
GROUP X TIME 
TIME X UNIT 



f>SI 

SUM OF SQUARES dF 

837.288 1 

336.408 12 

7131.047 115 

37.318 1 

0.928 1 

30.369 12 

480.067 115 



NIEAN SQUARE 

837.288 
29.701 
62.009 

37.318 
0^28 
^.531 
4.174 



F-TEST 

13.503*** 
0.479 
NOT TESTED 

8.940*** 

0.222 
0.606 
NOT TESTED 



TOTAL 



8873.414 



IS7 



34.527 



ITPA 

SOURCE SUM OF SQUARES DF MEAN SQUARE F-TEST 



SITE 


302. 


.278 


I 


302 


.278 




5.410* 


GROUP 


433. 


.957 


12 


36 


.163 




0.647 


UNIT 


6425. 


.625 • 


115 


55 


.875 


NOT 


TESTED 


TIME 


0, 


,290«' 


1 ' 


0. 


.290 




0.043 


SITE X TIMF 


19. 


,466 


1 


19. 


.466 




2.913 


GROUP X TIME 


213, 


,800 


1? 


17. 


.817 .. 




2,666** 


TIME X UNIT 


768. 


,474 . 


lis 


6. 


.682 


NOT 


ThSThD 


TOTAL 


8873, 


,414 


257 


31. 


.766 







Log TR.^SF6rM of MUTOR INHIBITION 



SOURCK 



SUM OF SQUAF<F..S 



ML/VN SQUARh 



I--TLST 



SITE 

CROUP 

UNIT 

TIME 

SITE X TIMI-. 
GROUP X TIME 
TIME X UNIT 



Jf'TAL 



0.004 
4.959 
21.411 

0.015 
0.075 
2.210 
5. 38 

34 . 1 1 3 



1 

12 
115 

1 

1 

12 
115 

257 



0.004 
0.415 
0. 186 

O.OIS 
0.07S 
0.184 
0.048 

0.133 



.0.022 
2 220* 
.N»T TEST J: I) 

0,312 
1 .574 
3.860*' 
NOT ThSTLD 



TABLE 1 (Con't.) 



UNWEIGHTED MEAN'S ANALYSIS OF V ARI,\NCE TAjLE 
Groups within Sites Repeateci~Measures/ Model 

eiASSIFYIN. FACTORS 



SITE 
GROUP 
TIME 
UNIT 


SITE 
GROUP 
TEST TIME 
SUBJECTS OR UNITS 


OF ANALYSIS 




SOURCE c 


MOTOR 
SUM OF SQUARES 


INHIBITION 

DF MEAN SQUARE 


F-TEST 


SITE 

GROUP 

UNIT 


43202.371 
1151927.000 
6274506.000 


1 

12 

lis 


43202.371 
9&993.875 
54560v9l8 


0.792 
1 .759 
NOT TESTED 


TIME 

SITE X TIME 
GROUP X TIME 
TIME X UNIT 


17345.016 
30126.953 
471969.563 
1530 385. OOC 


1 

1 . 

12 

lis 


17345.016 
30126.953 
39330.797 
•13307.695 


1.303 
2.264 
2.955** 
NOT TESTED 


TOTAL 

V 


9519460.000 


2S7 


37040.699 




SOURCE 


ENUM: COUNTING 
SUM. OF SQUARES DF 


ME.AN SQUARE 


F-TEST 


SITE 

GROUP 

UNIT 


30.535 
52.722 
1070.097 


1 
12 
115 


30.535 
4.393 
9 . 305 


3.282 
0.472 
NOT TESTED 


TIME 

SITE X TIME 
GROUP \ TIME 
TIME X UNIT 


0.946 
3.963 
22.023 
141.634 


1 

1 

12 
115 


0.946 
3.963 
1.835 
1 .232" 


- 0.768- 
3.218 
J. 490 

NOT TESTED 


TOTAL 


1321.920 




5.144 




SOURCE 


'eNUM: 
SUM DF SQUARES 


POINT I. \G 
'» DF 


AND TOUCH in; 

Ntf.AN squa;<h 




SITE -> 

GROUP 

UNIT 


28.734, 
28.732 
396.495 


1 

12 

1 15 


?8.734 
2 . 394 
3.448 


8. 334*' 

0 . 694 
NO.f TESTED 


TIME 

SITE X TIME 
GROUP X TIME ^ 
TIME X UNIT " 


0.440 
O.OOS 
16.321 
101 .534 


1 


0.440 
0.005 
. f 1 /360 
0.883 


0.498 
0.006 
! .541 
NOT TESTED 


10TAL 


572.260 


2S7 


2.227 
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UHVEIGHTED >!EANS ANALYSIS OF VARIANCE TABLE 
Groups within bites Repeated Measures Model 



CLAi>3IFYL\G FACTORS 

SITE SITE 
GROUP GROUP 
TIME TEST TIME 

UNIT subjects' or UNITS OF ANALYSIS 





ENUM: SA.ME 


ORDER 






SOURCE 


SUM OF SQUARES ■ 


DF 


' MEAN SQUARE 


F-TBST 


SITE 


0.186 


1 


0.186 


0.038 


GROUP 


24.771 


12 


2.064 


0.417 


UN J 7 


5^=9.713 


115 


4.954 


NOT TESTED 


TIME 


2.603 • 


1 


2.. 60 3 


2.381 


SITE X TIME ' 


2.663 


1 


2.663 


2.435 


GROUP X TIME 


23.645 


12 


1.970 


1 .802 


TIME X UNIT 


125.764 


115 


1.094 


NOT TESTED 


TOTAL 


749.345 


257 


2.916 ■ 


I 

\ 




ENUM: SAME 


NUMEER 






SOURCE - 


SUM OF SQUARES 


DF 


MEAN SQUARE 


F-TEST 


SITE 


0 . 290 


1 


0.290 


0.176 


GROUP 


16.146 


12 


1 .345 


U.817 


UNIT 


189:486 


115 


1.648 


NOT TESTED 


TIME 


' 2.834 


1 


2.834 


3.666 


SITE X TIME 


0.114 


1 , 


0.114 


, 0.148 


GROUP X TIME 


7.998 


12 


0 . 666 


0 . 862 


TIME X UNIT 


'88.903 _ 


115 


0.:''73" 


NOT TLSThD 


TOTAL 


305. 7 '/l 


257 


1.190 





. * 



ENUM: S.\Mo TOIAL 

SOUKCI: ' SUM OF SQUAHi.S L>1- . MhAN SQUARE F-TEbT 

► • * 

SHE 0.912 ■■ 1 0.y.!2 0.102 

GKOUr . 46.159 ■ 12- 3.849 " 0.415 

U.V1T 1066.322 1 15 9.27) ' .NOT TtSThD 

TIME ra.8"0 1 10.870 5.052* 

5;iTE X^TIME 3.'8Sl 1 5.&S1 1.804 

(■.;om^ X TIME . 51.348 . 12 2.012 1.214 

TIME X UNIT'' •■ 24.7.462 115 2. 152 NOT TESTED 

TOTAL " 1406.914 2S7 5.474 
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b'roken down by tester ^pairing and test^retest are 

presented in Table 2. For a description of the tests and 

the scoring proc'^'dure, see Part II and Chart 1. 

Of the elements of the test battery, the PSl , ^-he 

ITFA; and the Pointing and. Touching Subtest (Enumeration) 

demonstrate^! ' statistically significant site .effects • 

Significant time effects *^(the test-retcst oeriod being 

separated by a period of 10 days to two weeks) were found 

for the PSI^and the "same- total" subtest (Enumeration). 

in terms of assessinq tester bias, the important aNOVA 

term is the GROUP X TIMI] interaction term. A siqnificant 

result here indicatos that within n qroup (i.e., a tester 

pairirg) c-^t a given time point a result deviant from what 
i 

m.ig!:t:have been expected has occurred. T^^e most reasonable 
interpretation of such- an " int^ racti oi^ e f feet " is a tester 
•level |ef feet ("bias"). Siqnificant results on the ^J^VP 
^ TIM}!: intV^raction were foui^d foi the ITP^, Loq of the 
Motor 1 1 nhi bi t i on , and tho^ Mentor T nh ib i t ion . lixaini na t ion 
of the 1 il.V. contrasts of tho Group x Time Interaction 
from the: exact lea.st-su'jaro;^ -rinulyri i s indicates the- source 
of tncJ-'>o sicjr)i f icarit results (sec TtibJos 3A, 3B, 3C)-, 

^\ v;ord oi explarrjtion about these- contrcists i 
perhaij'S in oz;d*j:r. Tliesc'are sir-j/lo contrasts in v;hich 
each ttc'Styc r pairinq grouj^ is co::>pared to Kxijc rt-Kxpc r t 
group A at that site, 
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TABLE 3 

TABLE OF 1 DEGREE OF FREEDOM COMTPASTg! FOR 
GROUP (TESTER PAIRING} X TIME INTERACTION 



A: ITPA 



Contrast 



DIFFERENCE 



S.E. 



T-RATIO 



1.115 


1.6428 


0.6787 


3.415 


1.5377 


2.2333 


4.797 


1.4977 


3.202 


1.524 


1.4977 


1.018 


-0 .135 


1.6428 


-0.082 


-1.985 


1.5377 


'1.291 


3.439 


1.8554 


1. 853 


1.167 


2.1107 


0 . 55 3 


2.833 


1.9268 


1.470 


5.310 


2.0339 


2.611 


2.567 


1.8878 


1. 360 


3.389 


V 1.9 26 8 


1.759 



(PPI-PPI) 

(PP1-PP2) 
(PPl-El)- 
(PP2-PP1} 
(PP2-PP2) 
(E1-PP2)- 
(PP3-PP3) 
■CPP3-PP4) 
(PP3-E2)- 
(PP4-PP3) 
(PP4-PP4) 
(E3-PP4)- 



- (El-El) 

- (El-El) 
(El-El) 

- (El-El) 

- (El-El) 
(El-El) 

- (E2-E2) 

- (S2-E2) 
(E2-E2) 
- (E2-E2) 
- (E2-E2) 
(E2-E2) 



5: LOG TRANSFORM OF M I 



CONTRAST 


DIFFERENCE 


S.E. 


T-RATIO 


(PPl-PPl)- (El-El) 


-0.128 


0 .2740 


1 — tj 

-0.467 


(PP1-PP2)- (El-El) 


0.517 


0.2564 


2.019 


(PPl-El)- (El-El) 


-0.584 


0.249 8 


-2. 338 


(PP2-PP1)- (El-El) 


-0.031 


0.2498 


-0.124 


(PP2-PP2)- (El-El) 


-0.213 


0 .2740 


-G.777 


"(E1-PP2)- (El-El) 


0.362 


0.2564 


1.414 


(PP3-PP3)- (E2-E2) 


0.068 


0.3094 


0.220 


(PP3-PP4)- (E2-E2) 


0.048 


0.3520 


0.136 


(PP3-E2)- (E2-E2) 


0.105 


0.3213 


0.327 


(PP4-PP3)- (E2-E2) 


0.130 


0.3392 


0.383 


(PP4-PP4)- (E2~E2) 


0.213 


0.3148 


0 . 6 76 


(E3-PP4)- (E2-E2) 


0.074 ■ 

L : 


0.3213 


0.230 



I 
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TABLE 3 (cont . ) 

TABLE OF 1 DEGREE OF FREEDOM CONTRASTS FOR 
GROUP (TESTER PAIRING) X TiyJB INTERA.CTION 



C: M I 



Contrast 


DIFFERENCE 


S.E. 


T-RATIO 


(PPl-PPl) - (El-El) 


-5S. 135 


73. 3115 


-0 . 572 


{PP1-PP2) - (El-El) 


-0.885 


68.6233 


-0.013 


(PPl-El) - (El-El) 


-238.657 


66 . 8370 


- 3.571 


(PP2-PP1) - (El-El) 


13.525 


66 . 8370 


0.202 


(PP2-PP2) - (El-El) 


-98. 885 


73.3116 


- 1.096 


(E1-PP2) - (El-El) 


192.915 


68.6233 


2.811 


(PP3-PP3)- (E2-E2) 


32 .636 


82.8003 


0.390 


(PP3-PP4) - (E2-E2) 


55 . 167 


94.1831 


0 .586 


(PP3-E2) - (E2-E2) 


39.889 


85.9861 


0.464 


(PP4-PP3) - (E2-E2) 


46.429 


90 .7667 


0.512 


(PP4-PP4) - (E2-E2) 


102.200 


84 . 2488 


1.213 


(E3-PP4) - (E2-E2) 


45.556 ■- 


85 .9861 


0.530 



Ndte 1: There are 115 d. f . for error. 

Significance level = 0.05 for student's 

t = 11^98 (two tail test) 
Significance level - 0.05 for Dunnett's t 

statistic = +2.60 (two tail test) 



No'te 2: Dunnett's t statistic is a test for 

multiple comparisons of treatment means 
or contrasts among them with a control. 
It is based on the probeibility of falsely 
rejecting at least 1 comparison (C.F- Winer) 
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For example, the Group 5 contrast is as follows 



PPl-PPl Group 1 



TIME 1 



TIME 2 



PP2-PP2 / 

El-El 

E1-PP2 



5 
6 
7 



0 
1 

■1 
0 



Nested within 
0 site 



-1 
1 
0 



Under the nv.ll hy-othosis cf "no tnn tor effects/' 'Sr.-^. ex- 
pectation of this contrast is zero. Further, by definition, 
the experts exhibit zero "tester bias." Thus, this contrast 

becomes an estimate of paraprofessional tester bias. 

J 

For all three measures, the (source of the significant 

\ 

interaction is concentrated m the "^p^raprofessional testers 
at the Salt Lake site. For th<=^ ITPA, however, this is also 
some indication of significant interactions- at the Kansas City 
si-te. One must be somewhat cautious, however, in interpreting 
these results for the Kansas City site in that there were only 
6 children with valid test batteries for the E2-E2 tester 
pairing. 

In gfcneral, the results appear to indicate a strong tester 
bias on the part of paraprofessional 1 for all three measures 
(i.e., significant contrasts for (PPl-El) - (El-El) ). 
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There also appears to, be a tester bias' on the part of para- 
professional 2 for at least the Motor Inhibition, The pre- 
sence of such -signifipant results for such a small sainple 
indicates a considerable likelihood for extensive tester 
level effects ("bias") in the general HSPV study. As such, 
the reliability of these instruments for our purposes is 
indeed questionable, . 

TGst-Retest Correlations ' 

The test-retest correlations for Salt Lake and 
Kansas City are presented in Tables 4 and 5 respecti v^ely . 
In Table 6, the data for the parallel groups (1 and 8, 
2 and 9, etc.) is pooled across sites, and the correla- 
tions are recompu :ed. These correlations can be inter^ 

preted as coefficients of stability. They depend on 
conditions of retesting (e.g., tester), and the length 
of time between testings. As such, they are generally 
less than coefficients of precision. 

The results for the PSI and the ITPA both across 
sites and tester conditions are in general quite good. 
The estimates for the Motor Inhibition are less impressive. 
(There is in fact one negative estimate [Group 7 at 
Kansas City] ) . This combined with the information on 
the susceptibility of this instrument to tester bias, 
makes it an unsatisfactory measurement device. As for 
the subtests of Enumeration, with the exception of the 
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TEST i RETEST REL ^ R ILITY ESTIMATES BY TESTER PAIRING (Group #) 

SITE 209 : - SALT LAKE 




PPl-PPl PP1-PP2 PPl-El PP2-PP1 PP1-PP2 El-El E1-PP2 
1 ' 2 3 4 5 6 7 ... 



PSI 


.936 

(8) 


.778 

(10) 


.920 

, (11) 


.943 

■ ■ (11) 


. 894 

(10) 


.873 

(13) 


.962 

(11) 


ITPA 


.660 

(8) 


■ 

.798 
(9) 


.774 

'\ (11) 


.898 

(11) 


.949 

(11) 


.889 

(13) 


. 850 

(11) 


LOGMI 


.735 

(8) 


.743 

(9) 


.705 

(11) 


.675 

(11} 


.603 

(11) 


.673 

(13) 


. 541 

(11) 


MI 


.869 

(8) 


.883 
(9) 


.770 

(11) 


.682 

(11) 


.583 
■ (11) 


.615 

(13) 


. .616* 

(11) . 


Enumeration 
Pointing & 
Touching 


.054 

(8) 


.334 

(10) 


.516 

(11) 


.421 

(11) 


.893 

(10) 


.480 

■ (13) 


.548 

(11) 


Counting 


.950 

(8) 


. 395 

(10) 


.664 

(11)^^ 


.831 

(11) 


.798 ' 

(8) 


. .640' 
(13) 


.922 

(10) 


Same No . 


.326 

(8) 


.725 

(10) 


.676 

- (11) 


.229 

(11) 


. 875 , 
(10) 


.867 

(13) 


.431 

(11) 


Same Order 


.917 
(8) 


.579 

(10) 


,088 
(11) 


.147 

- (11) 


.800 

(10) 


.507 

(13) 


. 375 

(11) 


Same T^^tal 


.656 
(8) 


.763 

(10) 


.623 

(11) 


.219 

(11) 


.893 

(10) 


.878 

(13) 


.412 

(11) 



These are Pearson Product Moment Correlations: 
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TABLE. 5 

TEST RETEST RELIABILITY"" EST I MATES BY TESTER PAIRING 
■ (Group~F) 



SITE 2001': KANSAS CITY 



--^^ # <PP3-PP3 


PP3-PP4 


PP3-E2 


PP4-PP3 


PP4-PP4 


E2-E2 


E2 


-PP4 


TEST ^-^^ 


J. 


9 




A 








7 


Fo i 




. J 4 J 


9 

. 0 J J 


. D y D * 


^ Q 7 
.00/ 


• 0 0 0 




Q71 
. 5 / X 




(11) 


(6) 


(10) 


(8) 


(10) 


. (6) 




(9j 


± i srPi, 




c 0 

c .536 . 


. o4 1 


TOT 


A 

. 4 DD 


0 0 T 

• 0 Z J 




"7 Q '7 

. / y / 




(10) 


(7) 


(10) 


' (8) 


(10) 


(6) 




(9) 


T r^PM T 


R 'if. 

, D J D 


• J ^ 0 




< 

AC\ 
• 0 *1 U 


• D ±± 


R 9 n 

• 0 z u 






a 


(10) 


(7) 


(10) 


(8) 


(10) 


(6) 




(9) 


MI 


.526 


.226 


.804 


' .370 


.529 


.831 


-0 


.0312 




(10) 


(7) 


(10) 


(8) 


(io) 


(6) 




(9) 


Pointing 


\1^'8 


.45-S 


.115 


.845 


.913 


.818 


-0 


.249 


and 


(11) . 


(7) 


(9) 


(7) 


(10) 


(6) 




(9) 


Touching 




r 














Counting 


.936 


.753 


.760' 


.861 


.931 


.915 




.309 


(11) 


(6) 


(9) 


. (7) 


(10) 


(6) 1 




(9) 


Same No,. 


.875 


.706 


.247 


-0.258 


, .894 


1 

.759 ' 


-0 


.036,3 




(11) . 


(7) 


(9) 


(7) 


(10) 


(6) ; 

i 




(9) . 


Same Order 


.507 


.215 


.200 


.175 


.132 


-0.408 


-0 


.233 




(11) 


(7) ■ 


(9) 


(7) 


(10) 


(6) ; 




(9) 


Same Total 


.753 


.649 


.365 ' 


-0.265 I 


.504 


0.330 - 


-0 


.203 




(11) 


1 


(9) 1 


■ (7) 1 

j 


(10) i 

1 
i 


(6) 




(9) 



i 



These are Pearson Product Moment Correlations. 
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TAB LE ^ ' H •• • . 

TEST-RETEST RELIABILITY; PQOLSD ACROSS SITES 

(Group 



GROUP 
TEST^"""^"^"-"--^ 


1 


2 


3 


4 


1 

5 


6 . 


7 


PSI 


.952 


.658 


.885 


.903 


.833 


1 

.882 


.$23 




(19) 


(16) 


(21) 


(19) 


(20) 


(19) 


(20) " 


ITPA 


.820 


.569 


i 

.735 


.882 


. 840 


. 857 


.7 79- 




(19)- 


(16) 


(21) 


(19) 


(18) 


(19) . 


(19) 


LOGMI 


. 626 . 


. 564 


. 555, 


.623 


.459 


.710 


• . .302 




(19) 


(16) 


(21) 


(19) 


(18) 


(19) 


(19) 


MI 


.744 


. 599 


.550 


.652 


.421 


.714 „ 


.381 




(19) 


(16) 


(21) 


(19) 


(18) 


(19). 


119) 


Enumeration 


. 530 


. 318 


. ao7 


.620 


.906 


• .499 


.0276 


Pointing & 


(19) 


(17) 


(20) 


(18) 


(20) 


(19) 


- (20) 


Touching 
















Counting 


.946 


.496 


.690 


.801 


.87 8 


.700 


.636 




(19) 


(16) 


(20) 


(18) 


(18) • 


(19) 


(19) 


Same No. - 


.382 


.726 


. 521 


.0358 


.833 


. 847 


.0510 




(19) 


(17) ^ 

i 


(20) 


(18) 


(20) 


(19) 


(20) 


Same Order 


.608 


i 

.4 84 ' 


.132 


.242 


.575 


. 304 . 


.261 




(19) 


(17) : 

1 

! 


(20) 


(18) 


(20) 


(19) 


(20) 


Same Total 


.487 


i 

.737 ! 


.538 


.108 


.807 


. 79 0 ' 


.498 




(19) 


(17) : 

1 


(20) 


(18) 


(20) 


(19) 


(20) 
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counting subtest, the estimates vary greatly from one 
subtest to another, from one group to another. Because 
of the relatively small sample sizes, interpretation or 
these variations is perhaps inappropriate. Nevertheless 
it is quite clear that 'the seeming unreliability of the 
subtests m'ake them inadequate for our uses. 
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CHART 1 



SCORING PROCEDURES 



PSI 



All items on v/hich a child is correct, either verbally 
or non-verbally , is scored 1. The test score consists 
of the sum of correct items (ranqe = 0-32) . 



ITPA 

The test score consists of the sum of all the number of 
times each category occurs for all objects. 



Motor Inhibition ^ 

The test score is the slow time for the winding yp on the 
Tow Truck Task. The time is measured in 1/10 sees. The 
"Log of the Motor Inhibition " is simply the natural log 
of the slow time for the tow truck. A child's slow score 
is used only if the- child passed two out of the three pre- 
test tasks. 



ETS Enumeration: 



C ounting Subtest : (Items 2A, 3A, 4A) : Range (0-6)- 
A child receives 1 point for correctly counting each 
item {maximum - 3 points). A child receives 1 point 
for telling how many points there are, either by^ 
giving the correct nuitiber (irregardless of whether or 
not he previously counted to that number), or by giving 
a single incorx'ect number which is the same number he 
just previously counted to (maximum = 3 points) . 

Touching Subt est: (Items 6B-11B) : Range (0-6) 
A child receives 1 point for each, correct item. 

Same Number Matching : (Items 13C-20C) : Range (0-8) 
A child receives 1 point for each correct: item. 

Same Order Matching : (Items 22C-27C) : Range (0-6) 
A child receives 1 point for each correct item. 

Same Total Subtest : This is the sum of the same number 
matching and same order jnatchlng. subtests. 
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APPENDIX B 



Eight-Block Sort Reliability Study 

In the fall of 1971 in one site (Kansas City) Huron . 
Institute and SRI conducted an inter-observer reliability 
study of the Eight-Block Sort observations using the observer 
form included in both the Fall 1971 and Spring 1972 batteries. 
In this study two observers (paraprofessionals) simultaneously 
watched 20 children and three observers (two pciraprofessionals 
and one expert trainer) simultaneously observed 8 children. 

Definition of Variables 

The variables used in. this reliability study are displayed 
in Tables 1 and 2. The components of the Eight-Block Sort 
scoring sheet which constitute the variables outlined in 
Tcible 1 are numbered on the sample scoring sheet in Tcible 2. 
The SRI Spring 19 72 scoring procedures manual for Eight-Block 
Sort observers is attached at the end of this study (Chart 1) 
to give more information about the meaning of these variables. 

Some of the variables v;ith the'ir appropriate subcategories 
that one might like to obtain from the Eight-Block Sort 
observations are listed below: 



The observer forms used in the Fall 1969 , Spring 1970 , aiid 
Spring 1971 batteries v;ere different. 
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TABLE 1 

VARIABLES FOR ANALYZING INTER-OBSEPVER RELIi^^ILITY 
OF THE EIGHT-BLOCK SORT SCORING SHEET USED IN 
FALL 19 71 AND SPRING 19 72 OF THE HSPV STUDY 



Components gf . 

Variable # Name of Variable Score Sheet 

1 Orientation Time 2 

2 Training Time 3 

3 Mother's Training Time 1 

4 Mom Indicates Future (0) 4 
- 5 Mom Indicates Height (0) 5 

6 Mom Indicates Mark (0) 6 

7 Mom Indicates Ht.& MJt.{0) 7 

8 = (4+5+6+7) Mom Indicates Total (0) 4+5+6+7 

9 Mom Reason (0) 10+11+12 

10 Mom Praise (0) 8+9+18 

11 Mom Blame (0) 13+14+15+17 

12 - Child Talk Heiaht (0) 19 

13 Child Talk Mark (0) 20 

14 Child Talk Ht-& Mk. (0) 21 

15 = (12+13+14) Child Talk Total (0) 19+20+21 

16 Child Non-Work (0) ^ 22+2 3+2 4+26 

17 Child Observe (0) ' 25 

18 Mom Place Height (T) 27 

19 Mom Place Mark (T) 28 . . 

20 Mom Place Ht.& Mk. (T) 29 

21 = (18+19+20) Mom Place Total (T) 27+28+29 

22 Mom Talk Height (T) .30 

23 Mom Talk Mark (T) 31 

24 Mom Talk Ht.& Mk.(T) 32 

25 = (22+23+24) Mom Talk Total (T) 30+31+32 

26 = (21+25) Mom Train Total (T) 27+28+29+30+31+32 

27 Mom Reason (T) 35+36+37 

28 Mom Praise (T) 33+34+43 

29 • Mom Blame'^(T) 38+39 + 40 + 42 

30 Child Place (T) 44 

31 Child Goof (T) 45 

32 Child Talk Height (T) 46 
33% Child Talk Mark (T) 47 

34 Child Talk Ht.& Mk . (T) 48 

35 = (32 + 3'3+34) Child Talk Total (T) 46+47+48 

36 = (30+31) Child Work (T) * 44+45 

37 Child Non-Work (T) 49+50+51+53 

38 Child Observe (T) 52 

39 Success Ht.PlaccmGnt (0~2pts., ).. 54 

40 Siiccess Mk. Placement (0-2pts.) 55 
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TABLE 1 (cont.) 



Variable # 



Name of Variable 



1 



Components o| 
Score Sheet 



. 41 
42 
43 
44 
45 



(39+40) 



Success Placement (0-2pts.) 
Success Ht. Reason (0-2pts . ) 
Success Mk. Reason (0-2pts.) 
Success Reason (0-4pts.) 
Success Total (0-8pts.) 



54+55 

56 

57 
56 + 57 



(42+43) 
(41+44) • 



54+55+56+57 



Abbreviations -used include (0) - Orientation period, 
(T) - training period, Ht. - height, Mk. - Mark, 
Pts. - points. 

'Numerals represent whicli parts of 'the scoring sheet 
(see. Table 2) are used for each variable 
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TABLE 2 

EIGHT BLOCK SORT SCORItIG SHEET WITH HUflEPJ^XS IN 
SPACES USED TO FOPJ! VARIABLES FOR IMTCR-OB^^ERVER P^LIABILITY STUDY 

Adult's Name " , 

Relationship to Child Date 

Child's Name 

Child *s Ethnic Background 

Teacher ^ 

School/Conter 

Community /City ^ 

State 

Observer ^ 

Trainer 

Comments (absenteeism, refusals, etc.) 



Where was task administored and under what conditions? 




PARTI: TR^MNTSR TEACHING MOTHER ^ 

MOTIiJilR^S P;::RFOR?.L'iNCm:'IN TRAUaNG SKSSlON" 



Tiwe 
Started 



CYCLE 1: V HEIGHT 
CYCLE 2: 'MARK 
CYCLE 3; IIEIGOT V-AKK 
CYCLE 4: s6iiT S-BLOCKS 



NUT'IB^^R OF DID SHE SUCCPJKD ANY EKRORS TRAINER MADE? 
TRIALS ON FINAL TRIAL? / (Please specify) 



Yes^ 
Yes^ 
Yes^ 
Yes 



Ko^ 
No^ 
No^^ 

No 
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Tirne:^ trainer tcach4na mother - 1 



Time 
Ended 
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Time Started 



PART II: MOTHER TEACHING CHILD 



[orientation period! 



Orientation Tine - 2 



MOTHER 

INDICATES verbally or non-verbally: 

• 4 



future task 
height 



liARK 



HEIGHT & MARK 



DIRECT RLQUEST 
RESPOND 



COMMEN(J|, PJ^^Y.. 
PRAISE 



ACKLWLEDGI: 



BEMVXOU iVODIFICAT ION 

reason ^ 

question ^ 

firm 



.threaten, cicn^jan 



pjuni sn 

"I DON'T KNOW" 
IGNOFU^:, KO RKSPONS}:: 

REFUSE, KE.JKCT 

OBSERVE ________ 

BRIDE 



ENcoun/\Gt: 



^ * TASK IKilEn'-ArANC^ 



10 



11 



12 



13 



14 



15 



16 



17 



18 



CHILD 



SPECIFICAIJLY TALKING about i 



HEIGHT 



19 



MARK 



20 



HEIGHT h mRK 



21 



DIRECT REQUEST 
RESPOND 



COMMENTS, VI AY 22 
PRAISE 



ACKNOWLEDGE 



BEHAVIOR MODlFiavnON 
reason 



question 
fix*m 



threaten, demean 



punish 



"i DONVf KNO.v ' 
IGNORE, NO KI^S?0.<SE 

REFUSE, REJECT 

OiiSERVf: 

BRIBE 



23 



24- 



25 



ESCOUIlJ\CE 



TASK IRRlilJiVANCY 



26 



Tine Started 



MOTHER 



TRAINING PERIOD 



REQUESTS PLACING; 



HEIGHT 

MARK 



27 



2t 



HEIGHT & MARK 



REQUESTS TALKING; 



30 



HEIGHT 
I.IARK 



31 



HEIGHT & TrlARK 



32 



DIRECT REQUEST 

RESPOND 

TEACH 



cOjII^teots, play 

PRAISE 



33 
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TASK irfHRIi-'VANCy 
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Time Ended 

CHILD 



ACivNCVrLICDGK 


34 




BEHAVIOR :.:0DIFICATION 






reason 


35 




question 


36 




firm 


37 . ^ 




throaton, demean 


38 




punish 


39 




"I DON'T KKOV/" 
Tn\OTi;^ KO RESPONSE 


p - 

REFUSE /reject 


40 




OBSEHVK 


41 




BRIBE 


42 




— ■ 






EKCdU!iAC;E 


43 





PLACING BLOCrCS: 



44 



GOOFING AR0U1^^D; 



45 



SPECIFICALLY TALKING about: 



HEIGHT 
MARK 



HEIGHT & MARK 



DIRECT Ri;QUE3T 

RESPOND 

TEACH 



COMfrlEin'S, PL.\Y 
PRAISE 



ACKNOWLEDGE 



BEHAVIOR MODIFICATION 
reason ^ 



question 
firm 



threaten , deneaa 
punisli 



"I DON'T KNOV/ ' 
IGNOUE, NO ircISPONSE 



.REtTJSE, REJECT 

0I3SERVE 

BRIBE 



ENC0UrG\GE 



TASK IHR^.IJiVANCY 



46 



47 



49 



50 



51 



52 



53 
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— Mother's verbal communication to child 

a, positive 

b , negative 

c, neutral 
total 

— Task orientation and presentation to the child 

a. verbal 

b • non-verbal 

c. ordering of presentation 

— Child ' s responses to the mother 

a. work 

b . non-work 

c . verbal 

d. non-berbal 

Mother's control system of child (i,e. motivational 
techniques ) 

a. positive fi,e. , praise, approval, support, etc-.) 

b. negative (i.e . , blame , criticism, disapproval , etc 

— Child's success during testing period 

a. placement success 

b , re as on success 

Unf ortunatelv , only a few of these variables can be obtained 
from the observational sheets used in 1971-72. Some of the 
constraints imposed by the score sheets in defining variables 
are as follows : 

— In the orientation period, mother's verbal and non- 
verbal responses are recorded together. This is also 

— true in both the orientation and training periods for 
categories such as "praise", "acknowledge", "threaten", 
"refuse", "bribe" and "encourage "• Thus, it is imposs- 
ible to get an accurate comprehensive verbal variable 
for the mother. The only valid verbal varicible that 
can be specifically defined is mother's verbalness in 
task directions during training. 
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— Behaviors observed are recorded in only one place 
(except for the behavior modification behaviors) . For 
instance, if the mother gives an instruction about 
the heights of the blacks during the training 

period it is placed under "requests placing — 
height" or "teach". It should be placed under the 
former since the general rule given to observers is 
to code under the more specific category. In many 
cases f the behaviors coded are confounded. For 
instances, if a mother says quickly, "I'll get you 
an ice cream cone if you place this block correctly", 
a mark is placed under "requests placing" and not 
"bribe". A request such as "put this where it belongs 
and later I'll get you an ice cream cone" is scored 
first under "requests placing" and then under "bribe''. 
Thus, it is probable that some of the control system 
variables (i.e., "bribe", "threaten", "praise", etc.) 
are listed v/ith the "requests placing" category above 
the double line on the form, and that the behaviors 
recorded belov; the. double line are most likely conser-- 
vative estiraates, while the categories above the 
double line are more valid. 

— Orientation is defined as "ended" v;hen the mother 
gives her first instruction to the child to place a 



Information for coding obtained from an SRI trainer. 
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block. Thus, some orientation behaviors for some 
mothers are recorded under training. The mother 
v7ho explains all dimensions of the blocks to her 
child before requesting plc^cement of one block will 
probably appear to have a longer orientation period 
than the mother who explains one dimension and asks 
the child to place a block on that dimension before 
explaining other dimensions. Therefore, even though 
both of these mothers may use the same amount of 
orienting behaviors (although in a different, sequence) , 
the former motiier will have more behaviors and time 
marked under orientation on the present form. 

An accurate conception of how the mother teaches the 
child is hard to get since the sequencing of behaviors 
is not noted on the score sheet. The child's behaviors 
are recorded irregardless of what the mother requests 
or demands. Specific responses to the mother's 
requests are not known. 

During the testing period of the child ^ the mother is 
instructed to be auiet — i.e., neutral. If she is 
not neutral, the observer is required to identify the 
mother * a behavior as "rejection, dissatisfaction, non- 
verbal support, verbal support, or parent answered." 
Since these varieibles are complicated by the fact that 
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the mother is instructed to be quiet, they can not 
be used as part of a larger variable such as "mother's 
verbalness". For example, a normally "rejecting" 
mother may not be "rejecting" during the testing 
period since she is told to be auiet. 

In spite of these constraints the group of variables listed 
in Table 1 were chosen for preliminary analysis. In light 
of the problems outlined above / more confidence we have, more 
can be placed in those variables formed 'from categories 
above the double line for the orientation period (i.e./ 
variable #s 4, 5, 6, 7, 8, 12, 13, 14, 15) and th'e training 
period (i.e., variable #s 18, 19, 20, 21, 22, 23, 24, 25, 26 , 
30, 31 , 32 , 33 , 34 , 35 , 36), and in the success and time 
variables (i.e., variable #s 1, 2, 3, 39, 40, 41, "42, 43, 44, 45). 

Another problem encountered in determining meaningful 
variables is the lack of time ].imits for the oiyLentation 
and training periods. From a child development point of 
viev/, it can be argued- that the percentage of the total time 
a mother or child engages in a" particular behavior during 
the orientation and training period is a more satisfactory 
estimate of the behavior than just absolute frequency counts. 
For exan\ple, a mother who has ten tallies under ''requests 
talking" during a five minute training session may be 
teaching her child quite differently from the mother v/ho had ^ 
ten tallies under the same category during a fifteen minute 

ERLC 
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training session. One of these two mothers is probably 
more verbal and/or more instructive; it is difficult to say 
that the two mothers are equivalent because they have the 
same number of tallies • Since it is not certain which of 
the tv70 units af analysis (frequency counts vs. frequency 
per minute) is best for analyzing this observational data, 
both units were used in the reliability study for variables 
describing the orientation and training process* Only 

A 

frequency counts v;ere used for the success and time variables . 

Item and Score Characteristics 

Table 3 lists basic statistics (mean, standard deviation, 
skewness and kurtosis) for most of the 45 varia'bles , using 
frequency count as the unit of analysis (Part A) and for sev- 
eral of the varia}-)les, using frequency per minute as the 
unit of analysis (Part B) . These statistics are computed for 
each observer across twenty children. From those statistics 
using the frequency counts, it can be seen that several of 
the variables occur very infrequently: 4 -Mom Indicates 
Future (0) , 9-Mom Reason (0) , lO-Mom Praise (0) , 11-Mom Blame 
(0), 14-Child ,Talk Ht , & Mk . (0) , 16-Child non-work (0), 
29-Mom Blame (T) , 31-Child Goof (T) , and 34-Child Talk Ht. 
& Mk.. (T) . 

Several of the variables are positively skewed; in most - 
cases these arc the same variables that occur very inf reauent ly . 
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TABLE 3 



BASIC STATISTICS (FEAN, S.D., SKET^;^^^ESS ' 
AtJD KURTOSIS) FOR SEVERAL EIGHT-BLOCK 
SORT VARIABLES FOR EACH OBSERVER (01, 02) 



Part A - Unit- of Analysis = Frequency Count 



Variable # /N a me 



•Obse'rver 



Me an 



S.t). 



Skewn'ess' 



Kurtosi s 



1- Orientation 


0 1 


1 . 


400 


1 . 


319 




.5 74 


• 


7 78 


Tine ' 


0 z 


1 . 


IT r\ 

50 




910 




.09 9 


-1 . 


T T 

111 


^-Training Time 


0 X 


IZ . 


r\ ^ r\ 

050 


— ^ 
6 . 


9 4(5 




.12 3 


-1 . 


337 






X 1 . 


/ UU 


c 


O '3 o 

y 2 2 




TOT 
. 121 


-1. 


096 


■= ; — • i — -T ■ — 

3-^'otner Training 


01 


5 . 


150 


2 . 


.151 


' 2 


.458*** 


6 . 


]^ 4 ]^ -^r * * 


Time 


U Z 


b . 


f\ r\ 
oOU 


2 . 


n ^7 n 

272 


2 


.167*** 


5 . 


-J-J-j -k ** 


.4 -Mom Indicate 


01 




600 


• 


583 




. 36 3 




723 


r uture ( U ) 


U Z 


1 . 


050 


• 






. 36 8 




6 89 


5-Mom Indicate 


0 1 


3 . 


350 , 


2 . 


90 3 


1 


. 086* 


1 . 


468 


TTm f f\ ^ 
111. {U ) 






40 0 


2 . 


O O T 

^ ^ 3 




. 775 




2.2 5 


6-Mom Indicate 


01 


3. 


050 


2 . 


376 




. 254 




853 




U 2 


2 . 


Q c n 

y 3 u 


2. . 


^ c n 

'toy 




Ton 




997 


7~Mom Indicate 


01 


1. 


850 


2. 


007 




.614 


-1. 


158 


Ht. & Mk. (0) 


02 


1. 


250 


1. 


577 




.731 


-i. 


167 


8-Mom Indicate 


01 


8. 


850 


4. 


993 




. 027 




626 


Totar (0) 


02 


7. 


650 


4. 


819 




1301 




723 


9 -Mom Reason (0) 


01 




200 




673 


3 


. 5 77 ■■"*•* 


11. 


6 2 3 * * 




02 


' . 


100 




300 


2 


. 667*** 


•5 . 


j_ j_ 2^ * * 


10 -Mom Praise . (0) 


01 


1. 


900 


2. 


567 


1 


.636** 


2. 


4 82* 




02 




950 


1 . 


857 


2 


.038*** 


3. 


417** 


11-Mom Blame (0) 


01 




050 




218 


4 


.12 9*** 


15; 


'053** * 




02 




100 




300 


2 


. 667*** 


5 . 


1 1 1 * * * 


12-Child Talk Ht. (0) 


01 


2 . 


750 


2. 


605 




.461 


-l-v076 




, 02 


2. 


150 


2. 


330 




. 4 35 


■A 


526 


IS-'Child. Talk rk. (0) 


01 


2 . 


050 


2 . 


132 




.739 


0 ' 


47 3 




02 


1. 


800 


2. 


337 




.994 




4 66 


14-'Child Talk Ht. & 


01 




050 




218 


4 


. 129 ■^"** 


15. 


0 5 3 * ^' 


& Fik. (0) 


02 




100 




300 


2 


.667*** 


5 . 


] ]_ 1 * X * 


15--Child Talk 


01 


4. 


850 


4 . 


304 




.332 


-1 . 


T85 


Total (0) 


02 


4 . 


050 


4 . 


318 




. 745 




73 3 


16-Child Kon- 


01 




30 0 




714 


2 




7 . 


3-79-^-*^- 


vvork (0) 


02 


1. 


800 


6. 


735 


4 


. 060*** 


].4 . 


6 7 1 * * * 
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Significance levels * = 

* * - 

* * * — 



,05 
.01 
.001 
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TABLE 3 (con.'t.) 



Variable #/Name Observer 


Mean 


S 


.D. 


Skewness 


Kurtosis 


18-Mom Place 
Ht. (T) 


01 
02 


3.950 
3.300 


4. 

3. 


477 
648 


1. 310* 
1. 180* 


.789 
. 494 


19 -Mom Place 
Mk." (T) 


01 
02 


3.250 
3.400 


4. 
5. 


91S 
132 


2.704*** 
2 . 370*** 


7.694*** 
5. 826*** 


20 -Mom Plaice 

Ht. &* Mic. (T) 


01 
02 


15.800 
15 ..^ 50 


15, 
15 . 


045 
138 


1.212* 
1. 364* 


. 333 
.915 


21-Mom Place Total 
(T). 


01 
02 


23.000 
22 . 150 


17. 
16 . 


6^)7 ■ 
9 12 


1.247* 
1.211*. 


.668 -5 
.683 


22-Mom Talk Ht. (T) 


01 
02 


10. 300 . - 
8.900 , 


8. 
8 . 


984 
185 


.619 
. 998 


-1.034 
. 0 18 


2 3-Mom Talk Mk. (T) 


01 

02 


7. 550 
6.250 


5. 
4 . 


500 
700 


.979 
1.273* 


.869 
2.732* 


24 -Mom Talk Ht. & 
Mk. (T) 


01 
02 


8.900 
10 . 700 


7. 
9 . 


981 
19 8 


1.151* 
1. 104* 


.792 
. d9 2 


25-JMom Talk Total (T) 


01 

02 ' 


26.750 
25.850 


16. 
15 . 


226 
278 


.•416 
.509 


-.685 
-.518 


2 6 -Mom Train Total 
(T) 


01 
02 


49.750 
48.000 


. 28. 
27 . 


133 
6 31 


.741 
.625 


. 898 
. 409 


2 7 -Mom" Reason (T) 


01 
02 


.4.000 
1. 800 


4. 
2 . 


940 
088 


1.603** 
1.387* 


1.657 
.738 


28-Wom Praise (T) 


t)l 

02 


18.250 
14 . 650 


9. 

9 - 


762 
551 


. 305 
. 559 


-.594 „ 
-. 350 


2 9 -Mom Blam^ "(T) 


01 
02 


. 350 
. 350 




9-53 
792 


2.948*** 
2.310*** 


7. 772*** 
4.279*** 


30 -Chi Id /l^<^ (T), 


01 

02 


36.250 
35. 500 


23. 
25. 


34 3 
46 3 


. 811 
.672 


. 250 
-.294 


31-Child G^of VlT) 


01 
02 


.150 
. .150 




All 
All 


3.173*** 
3.173*** 


8. 829*** 
8 . 829*** 


32-Child Talk 
Ht. (T) 


01 
02 


11.450 
10. 350 


7. 
7. 


046 
227 


.06-2 
.407 


-1.473 ' 
-1.343 


33-Child Talk 
Mk. (T) 


01 

0-2 


10.550 
9.150 


7. 
6. 


652 * 
966 


.229 
.4 82 


-1.078 
-.696 


34-Child Talk Ht. & 
KJv. (T) - - 


01 
02 


1.000. 
1.450 


2. 
2. 


280 
765 


■ 2.681*** 
2.011*** 


5. 757*** 
2. 796* 


3 5 -Chi Id Talk Total 
(J) 


01 
02 


23.000 
20.950 


13. 
12. 


539 
706 


-.066 
.075 


-1.312 
-1.249 


3 6 -Chi Id Work fT) • 


01 
02 


36.400 
36 .6 50 


?3. 
25. 


4 27 
558 


. 79 2 
.658 


. 19 3 
-. 334 



\<\ - 19-20 . , 

2 

Significance levels ,* = .05 
(3 ** = .01 

ERIC *** = -001 
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TABLE 3 (con't.) 



Variable #/Naine 


'Observer 


Me an 


S.D. 


2 

Skewness 


2 

Kurtosis 


37-Child Non-Work 


01 


6.200 


11.634 


3 .289*** 


10. 


213*** 


(T). 


02 


5. 800 


9.750 


3 .197*** 


10. 


127*** 


39-Success Ht. 


01 


1.789 


. 521 


-2 . 443*** 


4. 


901*** 


Placement 


02- 


1. 789 


. 521 


-2. 443*** 


4. 


C) Q * * 


40-Success Mk . 


01 


1 . 789 


.521 


-2 . 443*** 


4. 


901*** 


Placement 


02 


1. 789 


. 521 


-2 . 443*** 


4. 


f) Q ]^ * * * 


41-Success 


01 


3.579 


.936 


-2 . 158*** 


g. 


125** 


Placement 


02 


3.579 


.936 


-2.158*** 


3. 


125** 


42-Success Ht.. 


01 


.842 


.987 


. 320 


-1. 


898 


Reason 


02 


. 842 


.987 


. 320 


-1. 


898 


4 3-Success Mk. 


01 


1. 158 


.933 


-.318 


-1. 


775 


Reason 


02 


1. 158 


.9 33 


-.318 


-1. 


775 


44-Success Reason 


01 


2.000 


1. 806 


.054 


-1. 


804 




02 


2 .000 


1. 806 


.054 


-1. 


304 


45-Success Total 


01 


5.579 


2. 369 


-.419 




999 




02 


5.579 


2.369 


-.419 




999 


Part B 


- Unit of 


Analysis 


= Frequency Per Minute 




8-Moin Indicate 


. 01 


6. 768 


3. 124 


.347 




470 


Total (0) 


02 


6.607 


4.036 


. 496 




826 


9 -Mom Reason (0) 


01 


.036 


.129 


3. 323*** 


9. 


077*** 




02 


.071 


. 175 


2.041** 


2 . 


167 


10-Mom Praise (0) 


01 


1.583 


1. 624 


1.290* 


1. 


317 




02 


.810 


1.285 


1.612* 


1. 


185 


ll-Mom Blame (0) 


01 


.071 


.258 


3.238*** 


9. 


Q y y * * * 




02 


. 107 


.279 


2.494*** 


4. 


798 


IB-Child Talk 


01 


3.708 


2.54-5 


.711 




379 


Total (0) 


02 


3.714 


3.29 3 


.772 




372 


16 -Chi Id Non-V<ork 


(0) 01 


.286 


.4 52 


.949 


-1. 


100 




02 


1.286 


3.963 


3.271*** 


8. 


832*** 


21-Moin Place 


01 


2.189 


1. 146 


. 811 




289 


Total (T) 


02 


2.029 


1.013 


1.19 6* 




944 


2 5 -Mom Talk 


01 


2. 390 


1.828 


.553 




417 


Total (T) 


02^ 


2 . 820 


2.162 


1.646** 


2. 


234* 



= 19-20 ... - 

2 

Significance levels * = .05 

= .01 

*** = .001 / 
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TABLE 3 (^on • t. ) 



Variable #/Name 


Observer 


Mean 




S.D. 


Skewness^ 


. 2 

Kurtosis 


2 6 -Mom Train . 




01 


5 4)78 


2 


.503 


1.140* 


.525 


Total (T) 




02 


4. 850 


2 


. 727 


1. 486** 


1.928 


2 7 -Mom Reason 


(T) 


01 


. 365 




.366 


. 829 


-.697 






02 


. 148 




.157 


. 924 


- . 510 


2 8-Mom Praise 


(T) 


01 


2.266 


1 


.945 


2 . 109*** 


4.578*** 






02 


1.748 


1 


.518 


1. 346* 


. 560 


29-Mom Blame 


(T) 


01 


.028 




.072 


2.648*** 


5.939*** 






02 


.038 




.086 


2 . 370*** 


4.645*** 


30-Child Place (T) 


01 


3. 529 


1 


.72 4 


1.023 


.230 






02 


3. 168 


1 


. 524 


.865 


2.263* 


31-Child Goof 


(T) 


01 


.010 




.0 32 


3. 535*** 


11. 343*** 






02 


.009 




.030 


3.6.90*** 


12 . 374*** 


35-Child Talk 




01 


2. 686 


1 


.358 


. 366 


-1. 124 


Total (T) 




0 2 


2 .617 


2 


.475 


1.696** 


2.273* 


36-Child Work 


(T) 


01 


3.538 


1 


■.721 


1.012 


.225 






02 


3. 177 


1 


. 522 


. 852 


2.267* 


37-Child Non- 




01 


.537 




.814 


3. 15 3*** 


9. 780*** 


Work (T) 




02 


. 380 




.635 


3.439*** 


11. 504*** 



Significance levels * = .05 

** = .01 
*** = .001 
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In addition, if the variable has a skewed distribution using 
frequency counts as the \anit, it tends to also have a skewed 
distribution using frequency per minute' as the unit. Variables 
which seem to be both infrequent and/or positively .skewed 
(with both units of analysis) are 9, 10 and 11 (Mora's Reason, 
Praise and Blame during orientation), 29 (Mom's Blame during 
training) , 14 and 16 (Child Talks Ht. & Mark and Child Non- 
work during orientation,) and 31, 34 and 37 (Child's Goofing, 
Non-work, and Talking Ht. & MJ<: . during training). Other 
Variables which appear to have positively skewed distributions 
(based on frequency counts) are 3 (Mother's Training Time) 
and 19 (Mom Place MJc. during training). 

The distribution of all the successful placement variables 
(39 , 40 , 41) are negatively skev;ed. There is a ceiling 
effect for these scores for both observers for every variable. 
Out of a total possible score of four points for successful 
placement, the mean for each observer for the .twenty children 
was 3.579 (S,D. = .936). 

Inter- observer Relialoility 

Reliability estimates for the- two paraprofessional observers 
were calculated in two v;ays. One estimate of the observers' 
agreement is the Pearson product-moment correlation coefficient. 
These correlations for thirty variables using frequency counts 
as the unit of analysis are listed in Table 4. The coefficients 
(which range from .147 for Mom Reason (0) to 1.000 for the 
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TABLJ 4 



INTER-OBSERVER RELIABILITY COEFFICIENTS FOR TWO OBSERVERS 
FOR SEVERAL EIGKT-BLOCK SORT VARIA B LES WITH 
FREQUENCY COUNTS USED AS UNIT OF ANALYSIS 





Correlation 


R's from 


Signirf icance. 


Variable #/Name 


Coefficient 


ANOVA 


F Observers 


1-Orientation Time 


. 783 


.724 


N.S. 


2-Traininq Time 


.936 


.938 


N.S. 


Total Time (1+2) 


.939 


.938 


N.S. 


8-Mom Indicate Total (0) 


. 804 


.787 


N.S. 


9 -Mom Reason (0) 


. 147 


.692 


N.S. 


10-Mom Praise (0) 


. 807 


.124 


N.S. 


11-Mom Blame (0) 


.688 


. 70 3 


.025 


12-Child Talk Ht. (0) 


.929 


.900 


.025 


13-Child Talk Mk. (0) 


. 865 


. 862 


N.S. 


14-Child Talk Ht. & Mk . (0) 


.688 


.65 5 


.025 


15-Child Talk Total (0) 


.945 


.931 


.026 


16-Child Non-Work (0) 


.241 


.9 39 


N.S. 


17-C|iild Observe (0) 


.694 


.051 


N.S. 


21-Mom Place 'Total (T) 


.982 


.981 ' 


N.S. 


25-Mom Talk Total (T) 


.958 


.957 


N.S. 


26-Hom Train Total (T) 


.987 


.986 


N.S. 


27-Mom Reason (T) 


. 800 


.976 


N.S. 


28-Mom Praise (T) 


.884 


.655 


N.S. 


2 9 -Mom Blame (T) 


.954 


. 829 


.010 


30-Child Place (T) 


. 940 


.939 


N.S. 


31-Child Goof (T) 


1.000 


1.000 


N.S. 


32-Child Talk Ht. (T) 


.908 


.901 


N.S. 


33-Child Talk J^k . (T) 


.9 35 


.917 


.025 


34-Child Talk Ht.&Mk.(T) 




.678 


N.S. 


35-Child Talk' Total (T) 


.963 


.952 


. 025 


36-Child Work (T) 


.941 


.940 


N.S. . 


37-Child Non-Work (T) 


.960 


.948 


N.S. 


38-Child Observe (T) 


. 443 


. 787 


N.S. 


41-Success Placement 


1.000 






44-Success Reason 


1.000 






45-Success Total 


1.000 







test for observers equals M^oj^gg ^-^^3.3 4- KSoj^gej^^ej. - x units 
20 children observed 
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success scores and Child Goof (T) are quite adequate. 
Sixty percent of the r's are greater than •900. Correlation 
coefficients for the same tv;o observers on a smaller group 
of variables using frequency per minute as a unit of analysis 
are listed in Table 5. These are not as high as those 
using frequency counts .as a unit of analysis. They range 
from .164 for Child Work (T) to .998 for Child Goof (T) . 
Only 12% of the variables have r's greater than .90. Thus, 
higher inter-observer agreement is obtained using frequency 
counts as the unit of analysis. 

The other estimate of reliability was calculated from 
the sums of squares of a one-way repeated measures " analysis 
of variance between the observers (with the observers' 
scores used as repeated measures) was completed for a parti- 
cular variable, ai\ estimate of reliability was calculated usii 
the follov;ing formula:''' 



a MS ■ - MS ^, . 
^ _ ^ unit witnin 

"XTtS . ^ - MS . , 77^ + MS . ^, . 

unit within v/ithm 

where unit = observer's scores 

h = if of observers 
SS 

MS = observer 
unit 

df u 

^observer 

SS ss 

MS , ^ , . = observer + observer x unit 
within 

^"^observer + ^^observer x unit 



O „ ^B.J. Winer, Statistical principles ,in experimental rlng^-ign , 
ERIC N^^ York, McGraw Hill, 1962, 
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TABLE 5 

INTER-OBSERVER RELIABILITY COEFFICIENTS FOR TWO 



OBSERVERS FOR SEVER7VL 


EIGHT-BLOCK 


SORT 


VARIABLES 




WITH FPilQUENCY PER 


MINUTE AS UNIT CF 


ANALYSIS 




t 


Correlation 


R' 


's Froin 


Signif i canoe -j^ 




Coefficient 




ANOVA 


F Observers 


21-Moin Place Total (T) 


.465 




.176 


N.S. 


25-M.om Talk Total (T) 


.536 




.995 


N.S. 


26-Mom Train Total (T) 


. 36 3 




. 30 7 


.010 


2 7 -Mom Reason (T) 


.660 




. 382 


N.S. 


28-Moni Praise (T) 


. 337 




.174 


N.S. 


29-Moni Blame (T) 


.544 . 




.571 


N.S. 


30-Child Place , (T) 


.167 




.321 


N.S. 


31-Child Goof (T) 


.998 




. 554 


N.S. 


35-Child Talk Total (T) 


.577 




.474 


N.S. 


36 -Chi Id Work (T) 


. 164 




. 858 


N.S. 


37-Cliild Non-Work (T) 


.900 . 




. 214 


N.S. . 


8-Moni Indicate Total (0) 


.720 








9-Moni Reason (0) 


.674 









10-Mom Praise (0) 


. 792 









ll-Mom Blame (0) 


.887 








15-Child Talk Total (0) 


. 827 








16-Child Non-Work (0) 


.417 








N = 20 children observed 











F test for observers equals HSoj^gerver 7 ^^observer x units 
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The reliability, coefficients calculatt \ from the ANOVA 
design for the variables using frequency counts as the 
unit of analysis {Table 4) are very similar to the product- 
moment correlation coefficients • They range from .051 
for Child. Observe (0) to 1.000 for Child Goof (T) , with 
57% of the r's being greater than .900. Seven out ot 28 
J tests for. observer effects are significant, meaning that 
for these scores there is a significant component of variance 
due to differences in observers. This can be attributable 
to differences in observers* concentration and attention 
to the children observed or to actual , differences in the 
frame of references the observers used to judge the variables. 

The reliability estimates calculated from the ANOVA 
design for the variables using frequency per minute as the unit 
of analysis (Table 5) are often not s. milar to the product- 
moment correlations. These estimates range from 1.76 for 
Mom Place Total (T) to .995 -for Mom Talk Total (T) v/ith one 
out of II (9%) being greater'^than .900 . Only one of the F 
tests for observer effects is significant. 

linally, estimates of inter-observer reliability for the 
three observers (K = 8 children) were calculated fro^ the 
TU^OVA design for ten selected variables using frequency 
counts as the unit of analysis (Table 6) . All of these 
coefficients are quite adequate, ranging from .406 for orien- 
tation time to .988 for Child Talk Total (0). One-half of 
the r*s is greater than .900; 90% is greater than .800. lour 

O 

ERLC 
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TABLE 6 



INTER-OBSERVER RELIABILITY CJ^iCULATED 


FROM AN OVA 


FOR THREE OBSERVERS FOR 


SEVERAL EIGHT- 


■BLOCK SORT 


VARIABLES WITH FREQUENCY 


COUNTS AS UNI^ 


ij|OF ANALYSIS 




■ d* 

R from 




Variable #/Name 


AMOVA 


Significance 


P-Mom Indicate Total (0) 


.942 


N . S . 


1' -Child Talk Total (0) 


.988 


N.S. 


2i-Mom Place Total (T) 


.890 


.00 3 


25-Mom Talk Total (T) 


. 834 


.011 


26-Mom Train Total (T) 


. 843 


.001 


35-Child Talk Total (T) 


.920 


.015 


36-Child Work (T) 


.873 


N.S. 


1-Orientation Time 


. 406 


N.S. 


2-Training Time 


.911 


N.S. 


Total Time (1 + 2) 


.914 


N.S. 



N = 8 children observed. 

"""F test for observers equals MSoj^gerver ^Soi^^gerve-r x units 
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of the F tes1;s (40%) for observer effects are significant. 
After looking at the raw data, this seerrs to be attributable 
to the fact that the expert observer V7as using a different 
frame of reference for 'rating than the two paraprofessionals . 

Variable Intercorrelations 

The intercorrelations of most of the Eight-Block 
Sort variables listed in Table 1 using frequency counts as 
the unit of analysis are listed in Table 7 for each of the 
two observers. The first number in the appropriate space 
is the correlation for the two variables for observer 1 
based on 20 children, while the second number in the space 
is the same correlation for observer 2. In most cases, 
the correlations for both observers are very similar. 
The intercorrelations among the success scores (variable #s 
39-45) are exactly tlie same for both observers. 

In general , many correlations are low . Some of the more 

interesting higher correlations between variables are as 

follows : 

— Nom Indicate Total (0) correlates .82/. 76 with Child 
Talk Total (0) . 

— Traininq Time correlates .66/. 70 with Mom Place Total (T) 
.62/.65'with Fora Talk Total (T) , . 77/. 80 with Kom Train 
Total (T) , and . 82/. 83 v;ith Child Work (T) . 

— Mom Train Total (T) correlates -.52/-. 49 with Child 
Talk To'ual (0), and .60/. 52 with Mom Praise (T) . 

~ Child Work (T) correlates .73/. 76 with Mom Place HT. (T) 
and .56/. 60 with Mom Place Total (T) . 
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— Child Goof (T) correlates .97/. 92 with Mom Blaine (T) . 

— Child Talk Total (T)' c(/rrelates ,89/. 77 with Mom Talk 
Total (T). 

— Child Non-Work (T) correlates . 72/.'59 wi th Mom Reaso*i 
(T) and ,86/. 72 with Mom Blame (T) • 

Successful height placement is negatively correlated 

(60's to 80's range) with Mom Reason (T) , Mom Blame(T), Child 

Goof (T) and Child Non-Work (T) . Successful mark placement 

is negatively correlated with Mom Reason (-.81/-. 69) and Child 

Non-Work (-.60/-. 45) during training. Successful placement 

(total) is negatively correlated with Mom Reason (-.90/- 75) 

.* 

and Child Non-Work (-.83/-.~73) during training. ' The largest 
•correlation for Total Success score was with Child Non-Work 
during 'training (-.60/-. 62). 

Intercorrelations for the tno observers .on some of the 
variables using frequency per minute as a unit of analysis 
are listed in Table 8. There are more discrepancies between 
the two observers' correlations for two variables using 
this unit of analysis^' than there are when frequency counts 
is the unit of analysis (Table 7). In addition, there are 
^ only a few interesting large correlations: Child Talk Total 
(T) correlates •95/*96 with Mom Talk Total (T) j Child Non- 
Work (T) correlates .88/. 92 with Child Gocff (T) . Of the 
three success scores used in the an^l^lts, only the success- 
ful placp^ment score correlates with a particular behav- 
ior in training in the .50's or above fpr both observers: 
Q -.66/-. 58 with Mom Reason* (T) and -.59/-. 60 with Child Goof (T) 
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In conclusion, most of the intercorreiations among the 
Eight-Block Sort variables selected for analysis in this 
study are low and fairly similar for both paraprofessional 
Observers. Even thoug]. some of i^e large correlations may 
be misleading, since, a numloer of th6 variables involved 
occur infrequently (see Table. 3) , a few suggest som4 inter- 
esting relationships that may exist between a mother's and/ 
or a child's behaviors that could be explored further in 
analysis of a larger sample., ' . 
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CHART 1 



ggl EirilT-BL C CK ?0R? TAS K 

scoRi::G pRoc- i:;:pz5 ti/nual 
■ rcR cbs:.:rvi;rs 



Materials needed: 
'Score Form 

Watch or clock with second hand ' \. ' ' 

Several #2 pencils 

General description: 

Th7 8-Block Sort task requires the cooporation of you as an obscrver,''your trainer who 
administers the task, and a mother/child ter^m. Your efforts in the entire procedure are 
especially important because you will observe and reccrc[ the interactions during: 

PART I: TRAINER TEAtHiNG MOTHER 
PART II: MOTHER TEACHING CHILD 
PART III: TRAIiviER WORKING WITH CHILD 

It is your responsibility to teach your trainer how to administer the task and how to v^ork 
with the child after the mother has taught her child the task. Two copies of tlie Admin- 
istration Manu :i! for Trainers are provided so you can each have a copyT 

The follov;irrj p.::::?s provide a step~by-stcp description of the use of each poition oi the 
score forrT\. Tdily marks cue u-^ed on the score form to record the verbal ijnd non-verbal 
interactions Wrai take place during the task. 

PLvc'SO f)iake surt> the form? are cornpleli^d f^rcperiy before reiurning tne(n to your Site • 
Coordiikilor. ' ■ , ' 



I 

I 

i 
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SCORING 



Instructions for con/pleting top of score form coverr 

For each chifd who should got the 8-Block Sort Task, fifl in the top of the scoring sheet. 
Fill it in. regardless of whether- or not the 8-Btock Soft Task was administered. 



If the task was not given, note the reason on the line Icibcled "Comments". For example: 
"The child moved," or "No longer in Head Start," or "Mother, could not come/' etc. 



If the task was given, fill in nt th^t time the line, "Wt]cre was task administered and under 
what conditions?" This infprniatior^ may have to do wiili the mother, the child, the task, 
or the physical arrangements under, which the task was sivcn. For excimple: 

"In nurse's office, phone rang constantly," or "Mother brought several other children, 
they remained in room," or "Small office, adminislijred task on flodr," or "Mother, 
could speak very little EnglisK" * • , 

It is better to record too much than not enough. Pre vide us with as cornplete ^ picture 
as possible. ' > 



/ 




, Part I: TRAINER TEACHING MOTHER 



/ 



/ 



/ 



Recq^d the starting timo of the mother's training session to the nearest' minute. 



For each section nolo the nutnber of tri^iis (from 1 to- 3) needed for the mother to learn 
the task. - * i 



Indicate v^hcthcr or not she sucrxedod on her ^lal trial for oixh section. 



We suggcrit that you.ind your trainer decide on some siytuit or cue to Indicate, and cut 
down on, troincT errors. For example: 



Verbal", "short', *'X", 



place", etc* 



Please write out v*:hat the errors v.'ere.iy/)/c?5s, she corrects herself. 



Record the ending drro cf the mother's trninih^j session to the . nearest minute. 



Part II: MOTHER TEACHING CHIL D 

ORIENTATION PERIOD 



Record the starting time of the child's ORIENTATION PERIOD to the nearest minute. 

The ORIENTATION PERIOD includes everything that happens from the time the mother starts 
teaching her child until she verbally requests the child to p/ace a block on the board . As soon 
as the mother requests a block placement, move immediately into the TRAINING PERIOD. 

The information we are asking you to tally above the double line during ORIENTATION 
PERIOD is the more specific information. If you feel that something could be tallied both 
above and below, the double line, tally it above the line only . For example: 

"See these tall blocks?" could be tallied under 
HEIGHT and also under DIRECT REQUEST. Please 
tally it under HEIGHT because this gives us more 
specific information. 

We are interested in how the mother familiarizes her child with the task prior, to requesting 
the child to place blocks. Please tally each time the mother indicates either verbally or non- 
verbal I y (pointing, gesturing with her hands). . 

On the following pages there are examples of the various types of interactions, between the 
mother and child arid where they should be tallied. 

MOTHER 

INDICATES verbally or non-verbally: 

"We're going to play a game." 
"I want to teach you something." 

"These are all blocks." 

"Look at the baby blocks .and the poppa blocks." 
"How are these alike?" (If the blocks are arranged so there is no 
doubt tliat mother is referring to sl^o.) 

Any, words or gestures the mother chooses to use tliat distinguish 
between different sizes are acceptable. 

"These are flowers and tliose are cherries." 
"Do yoif know what these letters are?" 

Any words or gestures the mother chooses to use that distinguish 
between different marks are acceptable. 

"These arc tall and have an X." 

"Tell me how these blocks are alike." (If the blocks are arranged 
in 4 groups by height and mark.) 

Whenever the board if set up with 4 groups or arranged in such a 
way that you arc unable to determine wiicther the mother is 
referring to height or mark, tally under HEIGHT & MARK. 



FUTURE TASK 
HEIGHT 

MARK 



HEIGHT & MARK 



:RLC 
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ORIENTATION PERIOD (cont'd) 



CHILD 



SPECIFICALLY TALKING about: 



HEIGHT 



'These are tall. 
"Big red block. 
''Baby block." 



MARK 



"Looks like a cheerio. 
"It's a circle." 
"Airplanes." 
'They're ^flowers." 



HEIGHT & MARK s "Tall X." 

"Little flowers." 
"Big cheerios." 

In order to score above the line on the child side of the score sheet the child must say words 
that distinguish height and/or mark. 

If the child points rather than talking you should tally under RESPOND. 

Do not tally phrases like "same size/' "they're alike/' under SPECIFICALLY TALKING; these 
remarks should be tallied below the line under RESPOND. 



The categories below the double line are defined below through the use of examples. Your 
most immediate, simplest understanding of the category is more than likely correct. When you 
think that something the mother or child has said or done could be tallied in more than one 
category, always tally it in the more specific category only. Never double tally except under 
BEHAVIOR MODIFICATION. Examples for the categories below the double line are: 



DIRECT REQUEST 



"h that chair high enough?" 
'''Please come in and sit over here.' 
"Can you see all right from there? 



RESPOND 



Child siis down where told. 

Child points to blocks. 

"Blocks are alt the same size." 

An answer to "Is that chair high enough?" or 

"Can you see all right from there?" should be 

tallied under RESPOND. 



COMMENT, PLAY: 



"It's hot in here/' 

"I can't remember what I'm supposed to do next." 
Child begins handling the blocks or building towers, 
ettlior on the board or off the board. 



\ ERIC 
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ORIENTATION PERIOD (cont'd) 

PRAISE 'That's perfect!" 

(of response) . "Goodt" 

"You did that so quickly." 

ACKNOWLEDGEMENT "O.K." 

(of response) "That's fine." 

"That's right, that's an X." (Repeating words.) 

Nodding, (non-verbal) 



BEHAVIOR MODIFICATION: 



One person attempts to change another person's behavior (usually the mother correcting 
her child). 

The most often heard behavior modification is simply "No" (following an incorrect 
placement by the child). 

Five sub-categories have been placed underneath BEHAVIOR MODIFICATION in order 
Jo give us more detailed information. * 

When you iee or hear behavior modification, always tally it in BEHAVIOR MODIFICATION, 
and then, if it fits in one the five sub-categories listed below, also tally it there. 



reason: 

question: 

firm: 



demean, threaten: 



punish: 



"No, it goes here because it is little." 

"No, that isn't right. Don't you see those arc all big?" 

"STOP PLAYING WITH THE BLOCKS!" 
"NOW WATCH WHAT t AM DOING!" 

"I don't know v/hy you can't do it right!" 

"If you don't sit up and listen I'm going to spank you," 

Mother shakes the child's arm (physical contact, in an 
unfriendly manner!) 



"I DON'T KNOW" 

IGNORE, NO RESPONSE Mother asks "What is this mark?" 

Child says "I don't know" or doesn't say anything or 

shrugs his shoulders. 

Child says "I v;nnt a drink of water." 

Mother goes right on with "What is this mark?" 
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ORIENTATION PERIOD (cont'd) 



REFUSE, REJECT 



OBSERVE: 



Mother says to point to the big blocks, and child says 

"No/' or shakes his head. 

"I don't want to play with these blocks." 

The mother sits and watches the child, but says or 
does nothing. 

The child sits and v^'atches the mother, but says or 
does nothing. 

(If this continues for more than a f§w seconds, tally 
about every 5 seconds.) 



BRIBE: 



''If you do it right we'll have some ice cream vvhen 
we get home." 



ENCOURAGE: 



'Keep trying. I know you can get it." 



TASK IRRELEVANCY: 
(Mother only) 



'These blocks are red." 
"Point to the square blocks." 



ERIC 
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Part II: MOTHER TEACHING CHILD 



TRAINING PERIOD 



The mother's first verbal request for block placement starts the training period. 
Record the starting time of the training period to the nearest minute. 
MOTHER REQUESTS PLACING AND/OR TALKING 



Requests must be verbal to be tallied under REQUESTS PLACING or REQUESTS TALKING. 

Do not tally pointing, gesturing, or holding a block up for the child to identify under s 
REQUESTS PLACING or REQUESTS TALKING. Rather, they should be tallied under DIRECT 
REQUEST. 

When the mother rewords a request for placement or talking, make one tally. For example: 

"Put this block with the other big^ ones. Put it over here with the tall o^i^s/' 
(One tally under REQUESTS PLACING by HEIGHT.} 

Several requests tied together are to be tallied as one request. For example: 

"Put the little X's here, and the big O's here, and the big X's over there and the 
fittle O's over there." (Hovv^ever, if the mother v^cjtls after each request for the 
child to place the blocks, these vyould be treated as four separate REQUESTS FOR 
PLACING by HEIGHT & MARK.) 

When the mother requests both placing and talking, put one tally under REQUESTS TALKING 
and one tally under REQUESTS PLACING. For example: 

'Tell me what this is (points to X on block) and put it v^/ith the others that have the 
same mark." (One tally under REQUESTS TALKING by MARK and one tally under 
■ REQUESTS PLACING by MARK.),,. 

When the mother has the blocks arranged in such a way, or asks a qutibtion in such a way, 
that you aren't sure whether she is referring to size or mark, tally under HEIGHT & MARK. 
For example; 

Mother has groups set up in no particular pattern, and says "Put this one where it 
belongs." (One tally under REQUEST PLACING by HEIGHT & MARK because you 
can't tell where she v»/anted it placed.) 

On the other hand, when the mother has the blocks arranged in the four groups and asks the 
child to tell her why the block v;as placed in the proper group it v/ou!d have to be a 
REQUEST TALKING by HEIGHT & MARK. For example: 



"Because it is big and has an X on it." 
Q (One tally under CHILD SPECIFICALLY TALKS about HEIGHT & MARK.) 



SOS- 



TRAINING PERIOD (cont'd) 



CHILD PLACING BLOCKS 

Remember that the mother's first request for block placement starts the training period; from 
then on you tally each time a child places a block on the board, regprdloss of whether or not 
the mother has requested it. For example: 

* ' ' 

Mother says "Place all the big blocks on the board/' 

Child picks up six blocks, one at a time, and places each one on the board. 
(Make six tallies under PLACING BLOCKS.) 

When two or more blocks are placed at one time with one hand, put one tally under child 
PLACING BLOCKS. * 

When a child moves a block around before finally leaving it on the board, make one tally 
under PLACING BLOCKS, 

If a child reponds with placement and talks at tho same time , put one tally under PLACING 
BLOCKS and one tally under SPECIFICALLY TALKS. 

GOOFING AROUND 

When the child is playing with the blocks, building towers, etc., each time he places a block 
on the board put a tally under GOOFING AROUND, For example; 

Mother says to put a block with the others just like it and child puts it on top 
of the others. This is stil! considered a placement on the board, but in a "funny" 
way. 

CHILD SPECIFICALLY TALKING about: 



-(Same as ORIENTATION PERIOD, see page 6) 



Most of the categories below the double line are the same for TRAINING PERIOD as for 
ORIENTATION PERIOD, see pagos 6 thru'^B. The following are exceptions: 



DIRECT REQUEST: 



"Point to the X/' 

r/othcr holds up a block for the child to identify but doesn't 
say anything. (Requests must be verbal during training period 
in order to go above the line.) 



TEACH: 



"There are 8 blocks here, Johnny, and they are different 
heights." (Any task related information that 
doesn't ask the child to place a olock or say something 
about the heigfit or mark.) 



COMMENTS, PLAY: 



When tho child plays with the blocks off tJie board . 
(On the board is GOOFING AROUND.) 



Part III: CHILD REQUESTED TO PLACE BLOCKS AND SAY WHY 
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We are interested in how the mother reacts ais well as what the child says and does. So watch 
both and record responses in appropriate places. 

The child will first be given the SHORT 0 block to place and say why he placed it there. Record 
where t^,e child placed it under CHILD PLACED BLOCK WITH: 

! ' ^ 

Watch the mother's reaction. Circle anything you note. Circle at least one response. 

I , 

The trainer will now <isk the child up to 4 questions in order to get the child to say "small 
0" (or any words meaning small and 0). After each question write down everything the child 
says or does. If child moves block after being questioned, record final location , and again ask 
up to 4 questions. For example: 

Trainer says "Put this block where it belongs." 
Child places SHORT 0 with other short 0 blocks. 
Trainer says "Vv^hv does it go there?" 
Child says "It's little." 

Trainer says "What else can you tell me about why it goes there?" 

(You may use up to 3 probes — such as "Tell me more about why it goes there." 

or "What is another reason why you put it there?") 

You may use the following abbreviations: 

DK "I don't know." 
NR No response 

NV Non-verbal {gesturing height, etc.) 
The trainer will then repeat the above procedures for TALL X block. 

Be as complete as possible. Distinguish clearly between verbal and non-verbal answers. Please 
indicate NV in front of all non-verbal ani:wers so vvc have a complete picture of what the 
child did as well as what he said. 

Circle as many of mother's reactions as appropriate (at least one). Following is a description 

Mother blamed the child for failure' or made derogatory 
remarks about him. 

Mother scowled, frowned, showed impatience, but did not 
openly blame or accuse him. 

M9ther did not get involved. She watched the interaction 
between the child and trainer, but dicJ not reveal her reactions. 

Communicated sympathy, confidence and/or support by small 
cxprcssons (without saying anything). . 

Mother praised the child if he succeeded, reassured him if 
he failed. 

Motlicr answered for the child or gave him information 
or answers. 



of each code: 
Rejection: 

Dissatisfaction: 

Neutral: 

Nonverbal support: 
Verbal support: 
O nt answered: 
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APPENDIX C 

Classroom Behavior Inventory Test-Retest Reliability Study 

A test-retest reliability study of the Classroom Behavior 
Inventory was conducted in the fall of 19 71 by the Huron 
Institute and SRI. Teachers in four sites (Kansas City, 
Des Moines, Lafayette, and Greeley) rated the children in 
their classes on the Classroom Behavior Inventory in both 
the seventh and ninth weeks of the school year. The Class- 
room Behavior Inventory is a 15 item, seven-point rating 
scale, which measures three basic trait categories: task 
orientation , extraversion , and hostility, (For a complete 
test description with a list of the items, see Part II.) 

Factor Analysis 

A principal components analysis followed by a varimax 
rotation (i.e., rotating until the loadings on each factor 
have a maximum variance) v;as done on the pooled seventh 
and ninth week scores for the total sample (n = 464). 
This analysis revealed the existence of the three factors 
named by Schaefer in developing the test: Factor 1 — Extras- 
version ; Factor II — Hostility; Factor III — Task Orientation 
CSee Table 1). The eigenvalues for these factors (6.614, 
3.506, and 1.943) were the only ones greater than 1.000. 
Altogether the three factors explained 80.4% of the total 
variance. 
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Test--retest Estimates 

Results of test-retest reliability estimates calculated 
in two ways are listed in Table Z. One estimate is the cor- 
relation coefficient between the seventh and ninth week ^ 
scores for each subtest. The correlation coefficients, rang- 
ing from . 589 to .830, were "^adequate for test-retest esti- 
mates of sxibtests of a rating scale. The other estimate 
of reliability was calculated from the sums of squares of 
a one-way repeated measures analysis of variance design. 
After an analysis of variance between subject's scores 
with. the two times as repeated measures was completed for 
each subtest at each site, an estimate of reliability was 
calculated using the following formula from Winer^ : 

K ^S^j^^^ - MS^ithin J 
r = bz 



where unit = scores 

h = number of times rated 



^^unit ~ _^^scores 



^^scores 



^^within ■* .^^time ^^time x score 
^^time ^^time x score 



■'"B.J^ Winer* Statistical principles in experimental 
design (New York: McGraw-Hill, 1962) . 
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TABLE 2 



TEST-RETEST RELIABILITY COEFFICIENTS FOR THE 
CLASSROOM BEHAVIOR INVENTORY 




Correlation 
Coefficients 



R's from 
ANOVA 



Signif ic^ce 
F pMe^ 



Kansas City (n = 201) 
Task Orientation 
Extraversion 
Hostility 

Des Moines (n = 81) 
Task Orientation 
Extraversion 
Hostility " 

Lafayette (n = 75) 
/Task Orientation 
Extraversion 
Hostility 

Greeley (n = 107) 
Task Orientation 
Extraversion 
Hostility 

Total (n = 464) 

Task Orientation 

Extraversion 

Hostility 



784 
724 
795 



. 806 
.785 
. 830 



.764 
.757 
.658 



.589 
.710 
.591 



. 760 
.740 
.726 



.783 
.722 
.777 



803 
769 
819 



726 
760 
651 



557 
689 
520 



754 
737 
704 



b).S. 
N.S. 



N.S. 
.044 
N.S. 



.002 
N.S. 
N.S. 



N.S. 
N.S. 
.001 



.014 
N.S. 
.001 



ERIC 



jp" V test for time effects equals MS^ime MStime x units- 
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These reliability estimates., ranging from .520 to .819, . 
were very similar to the correlation coefficients. 

Several of the F tests for^ time effects were significant, 
meaning that for these scores tiiere was a significant com- 
ponent of variance. ^due to change over time. This can be attribute 
to changes in the actual behavior of children and/or 
changes in the rating "framework" used by the teachers. 
The reliability estimates calculated from the ANOVA design 
can be considered estimates of stability. These stability 
estimates are generally at the lower bounds of the relia- 
bility estimates. 

Item and Score Characteristics 

■ ?r 

Analysis of the distribution of items and subtest 
scores reveals that there are ceiling and floor effiscts 
(see Tables 3, 4, 5). Scores for each subtest range from 
7-35« High scores on the Task Orientation and Extraversion 
subtests and low scores on the Hostility subtest indicate 
the more "soci^ally desirable" responses. 

The distribution of scores for the Task Orientation 
subtest and the Extraversion subtest were negatively skewed 
at all sites. There was a definite ceiling effect for 
the Task Orientation score for both times at only one site-- 

o 

Kansas City. There was a potential ceiling effect for 
the Extraversion score at two sites — Kansas City and 
Lafayette. 
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TABLE 3 



STATISTICS FOR TASK ORIENTATION SCORES' 



7 weeks 

Total . 

Kansas City 
Male 
Female 



MEAN 



24.196 



25.827 
27.144 



SD 



7.043 



6.514 
5.941 



N 



464 



104 
97 



SKEWNESS 



-0.469*** 



-0.592* 
-0.889*** 



KURTOSIS 



-0.729** 



-0.513 
0.385 



Des Moines 
Male 
Female 

Lafayette 
Male 
, Female 

Greeley 
Male 
Female 



20.837 
23.344 



21.615 
24.861 



21.593 
23.500 



6.. 675 
6.509 



7.594 
8.163 



7.266 
6.147 



49 
32 



39 

36 



59 
48 



■0.053 
•0.17 3 



•0.165 
•0.841* 



■0.177 
-0.^33 



-1.192 
-1.208 



-1.034 
-0.496 



-0.901 
-0.925 



9 weeks 

Tot^al 

\ 

Kansas City 
Male 
Female 

Des Moines 
Male 
Female 

Lafayette 
Male 
Female 

Greeley 
Male 
Female 



24.735 



26.212 
27.598 



21.184 
23.500 



23.436 
26.917 



22.350 
22.500 



^Score range (7-35) 



6.344 



6.845 
5.586 



5.714 
6.304 



6.613 
6.403 



4.832 
4.776 



464 



104 
97 



49 
32 



39 

36 



-0.584*** 



■1.351*** 
•1.228**-* 



0.196 
■0.107 



-0.366 
-0.630 




59 -0.520 
48 -0.664 



Significance levels 



2.607* 
1.572** 



■0.396 
•1.068 



•0.975 
•0.845 



0.214 
0 . 014" 




ERIC 



* .05 
** .01 
*** .001 
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TABLE 4 



STATISTICS FOR BXTRAVERSION SCORES^ 



7 weeks 
Total 



MEAN 



25.015 



SD 



6.594 



N 



464 



SKEWNESS 



-0.609*** 



KURTOSIS 



-0.383 



Kansas City 
Male 
Female 



//^ 25.846 
25.670 



Des Moines 
Male ; . 
- Female 



23.878 
22.781 



6.703 
6.509 



6 .534 
6.559 



104 
97 



49 
32 



-0.675** 
-0.546* 



-0.235 
-0.919* 



-0.377 
-0.647 



-0.706 
-0.232 



Lafayette 
Male 
Female 



25.564 
27.833 



5.619 
5.950 



39 
36 



-0.747 
-1.247** 



-0.404 
1.142 



V 



Greeley 
Male 
Female 



9 weeks 
Total 



23.424 
23.937 



25.317 



6 .605 
6 .908 



6.135 



59 
48 



464 



-0.311 
-0.J92* 



-0.749*** 



-0.555 
-0.127 



0.768*** 



Kansas City 
Male 
"Female 



2^.856 , 
2e.835 , 



7.387 
5.755 



104 
97 



-1.115*** 
-0.799** 



1.325** 
0.492 



Des ^Moines 

Ferft^ie- 

Lafayette j 
• \ Male ...r- 
Female 



25.122 
23.219 

A. ■ 

25.'333 
27.639 - 



5.566 
5.638 

/e.iio 

4.969 



49 
32 



-0.050 
-0.624 



39 -0.696 
36-' -0.656 



-0.'354 
0.036 



/ 



-0.542 / 
-0.313 ■ / 



Greeley 
Male 
Female 



23.559 
23.083 



'Score. range (7-35) 
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5.351 
5.044 



59 -0.633* 
48 -1.116** 



Signi| 



ilficance levels 



0.827 / 
1.102/ 

/ 

/ 

*/ .05 
*/ .01 
*** .0.1 
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TABLE 5 



STATISTICS FOR HOSTILITY SCORES" 



7 week? 
Total 

Kansas City 
Male 
Female 



Des Moi 
Male 
Female 

Lafayette 
Male 
Female 

Greeley 
^Male 
Female 



MEAN 



12.765 



13.077 
11.536 



14 .367 
12.531 



11.487 
12.500 



14 .203 
12.562 



SD 



6.506 



6.344 
5.483 



7.126 
6.877 



5.703 
7.225 



7.712 
5.975 



N 



464 



104 
97 



49 
32 



39 
36 



59 
48 



SKEWNESS 



1.201*** 



1.179*** 
1.173*** 



0.873*- 
1.463*** 



0.909* 
1.228** 



0.959** 
1.498*** 



KURTOSIS 



0.947*** 



0.817 
1.293** 



•0.054 
2.026* 



■0.081 
1.197 



■0.385 ' 
2.189** 



9 weeks 
Total 



11.366 



6.111 



464 



1.343*** 



1.882*** 



Kansas City 
Male 
Female 

Des Moines 
Male 
Female 

Lafayette 
Male 
Female 



12.010 
10.113 



12.878 
12.875 



10.000 
li:889 



7.044 
5.037 



6.382 
5.923 



5.740 
7.230 



104 
97 



49 
32 



39 
36 



1.203*** 
1.455*** 



1.207*** 
0.906* 



2.226*** 
1.283** 



1,296** 
1.892*** 



1.348 
0.528 



6.232*** 
0.916 



Greeley 
Male 
-female 



11.051 
11.062 



5.856 
4.965 



59 1.216*** 
48 0.762* 



1.375* 
0.591 



^Score range (7-35) 
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significance levels 



* .05 
** .01 
*** .001 
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The distribution of the Hostility subtest scores were 
always positively skewed. There was a floor effect for 
these scores at botl-i times at every site. The skewness 
statistic for males and females at each site for both 
times was significant. In addition, the median score 
for each item in the Hostility subtest was 2 (item scale 
1 to 7) for each site at each time. 
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APPENDIX D 
Coding Reliability Study 

A reliability study was done in fall *71 at Stanford 
Research Institute on the coding of the Brown IDS Self- 
Concept Referents Test, the ETS Enumeration Test, and the 
ITPA Verbal Expression Subtest. Twenty of each test were 
picked at random and were coded independently by each of 
the three coders working on the test. 

Brown IDS Self-Concept Referents Test : The Brown 
is potentially difficult to code. The tester is asked to 
spot code only answers which are verbatim repetitions of one 
of the choices given in the test. The tester is asked to 
record other responses, and to indicate repeats. The 
coders are then responsible for judging whether responses 
are exact equivalents or not. They are also asked to code 
the number of repeats, and whether or not the child is 
smiling. 

To check coder reliability/ we calculated the number 
of times each pair of coders disagreed on coding responses, 
on the number of repeats, and on whether the child was 
smiling or not. On responses to the questions in the body 
of the test, there were 16 responses per child, or 320 in 
all. Coder 1 and 2 disagreed twice; coders 2 and 3 did not 
. disagree, and coders 1 and 3 disagreed twice* 
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Thus, the percent agreement of the three coders (CI, C2, C3) 
is as follows: 

C1/C2 = 99.4% 
C2/C3 = 100.0% 

/ 

C1/C3 =99.4% 

On repeats , the coders were in exact agreement on the number 
of repeats the following percentages of the time: 

C1/C2 = 13/20 = 65%^ 

C2/C3 = 16/20 =80% 

C1/C3 = 14/20 = 70% 
Perfect agreement is a very demanding test. A simple per- 
cent also gives no indication of whether the discrepencies 
were large or small. As another measure of agreement, there- 
fore/ one can look at the correlation coefficients between 
the pairs of coders. 

r = .966 
12 

r = .993 
23 

r = .961 
13 

For smiling, there were three possible codes: smiling, 
not smiling and indeterminant. Coders were in agreement 
on the following percentages of the tests: 

C1/C2 = 15/20 = 75% 

C2/C3 = 17/20 = 85% 

C1/C3 = 15/20 = 75% 

ERIC 



518 



ETS Enumeration Test ; On the ETS Enumeration test, 
coders are responsible for combining the information 
recorded by the testers into a series of codes expressing 
both the answers which the child gave and the types of 
errors which he made. We looked at coding reliability for 
three sections of the test: 

Part A (top) in which the child counts^ 
Part A (bottom) in which the child tells 

how many dots there are. 
Part B in which the child simply points to 
data. 

On part A (top) there are four questions or 80 responses 

in all which must be coded. Agreement among the three coders 

was as follows: 

t\/Q2 = 11/^0 = .96 

C2/C3 = 76/80 = .95 

C1/C3 = 75/80 = .94 
On Part A (bottom) there are also four responses per child. 
Agreement between coders was as follows: 

C1/C2 = 78/80 = .98 

C2/C3 = 77/80 = .96 

C1/C3 = 77/80 = .96 
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On Part B, there were six items per child. Agreement among 
coders was as follows: 

C1/C2 =11^/120 = .99 

C2/C3 = 119/120 = .99 
, ^ C1/C3 = 119/120 = .99 

ITPA Verbal Expression Subtest: The ITPA Verbal 
Expression Subtest is the most difficult test in the 
battery to code. The child is asked to tell "all about" 
four different objects. The tester records the child's 
response verbatim. The coder is responsible for trans- 
forming this information into a quantitative description of 
the child's output in a number of categories: name, color, 
shape, use, etc. The coders use 10 categories; for each 
object, or 40 in all. One measure of agreement, therefore, 
is the % of categories for which the coders achieve perfect 
agreement. These percentages for three coders are as 
follows: 

C1/C2 ^ 784/800 = 98% 

C2/C3 = 776/800 = 97% 

C1/C3 ^ 784/800 = 98% 
These percentages are deceptively high, however, since well 
over half of the categories on each protocol are b^lank 
(For the t./enty protocols in our coding reliability sample, 
the numbers of categories left blank by all three coders 
ranged from 26-35.) 
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A second, and more useful, measure of agreement is the 

correlation between the total numbers of scored responses 

recorded by each coder: 

r = .965 ^ 
12 

r = .968 
23 

r = .957 
13 

Structure measures, such as a measure of item by item 
perfect, agreement could, of course, be devised. Nonethe- 
less, the coding reliabilities which we have presented in 
this section indicate that coding errors have negligible 
effect on the quality of the data used in the analyses. 
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APPENDIX E 

Classroom Infoimation Form Reliability Study 

Demographic data for the HSPV analysis is obtained from 
the Classroom Information Form (GIF) . This form is filled 
out by Head Start teachers, often from the application forms 
filled out by parents. For each child, the teacher is asked 
to list the education, occupation and employment status of 
both parents; the number of adults and children in the home; 
the language spoken in the -home; and whether the child has 
had previous Head Start experience. 

In order to check on the reliability of this data, a 
comparison was made of the responses of parents and the 
responses of teachers on the GIF. Mothers of one-third of 
the Head Start children in the fall of 1971 were given the 
Eight-Block Sort Task and filled out a Parent Information 
Form (PIF) . In the fall of 1971, the PIF was designed to 
elicit demographic data as well as attitudes and partici- 
pation data. This data was used to check the reliability 
of the GIF data collected at the same time. 

There are two issues that are examined in the analysis 
of the GIF and the PIF data: 1) the percent response and 
2) the level of agreement between the PIF and GIF. The 
percent response is important because it constitutes an 
upper limit to the level of agreement. One can have very 
high agreement (for those cases reported on the GIF) , but 
have a very low response rate. In this situation the 
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"high agreement" is spurious, and is considerably deflated if 
we consider those people for whom no information was supplied. 
In general, there is a higher level of non-response for the 
CIF than for the PIF. Tho percent response on the PIP must 
be viewed as a base line for the percent response^ on the CIF. 
Our analysis assumes that the correct response is the one given 
by the parent. There ^are several obvious reasons why this 
may not be true. Although this is in all likelihood a minor 
contribution to the "noise," it is probably a statistically 
significant one. 

Site Variations : 

Although some sites seem to be worse than other sites 
on particular questions, no one site was uniformly poor,' 
We initially examined both percent response and percent per- 
fect agreement (as well as a series of measures of association) 
for each' of the questions for each site. We then / analysed 
all of the sites as a group. Next, we deleted v/hat appeared 
to be the worst six sites, and analyzed the remainder as a 
group. In general ^ on these aggregate analyses few differ- 
ences were found. We interpret this as indicating a homo- 

geneity of response pattern across sites . 
* 

Our convention in reporting information is as follows: 
Percent perfect agreement is based on all of the data in- 
cluding missing responses. Any statistic reported . (e .g . , 
Pearson r^ Kendall's Tau). is based upon only those subjects 
for which a response is recorded on both the PIF and CIF. 
Thus, in interpr^eting such statistics^ one must also 
consider the percent response. 



Preschool Experience; 

Across all-sites^ there was 79.9% perfect agreement. 
The response rate was quite good: 97% GIF vs. 99% PIF. 
Across each site, the percent perfect agreement . ranges from 
62% to 100% with 15 out of the 23 sites above 86%,. On both 
percent response and percent agreement this is one of the 
best questions on the GIF. In tentis of those who were" 
misclassif ied, children were more often (about 2 times) 
classified as having had preschool experience^ when in fact 
they had not?, than classi f ied • in any other combination. 

Mother ' s Education : 

Of all the Education and Occupation questions, this had 
the best results. Across all sites, the response rate was 
81.6% for the GIF vs. 99.1% for the PIF. Perfect agreement 
was 52%. The Pearson r reliability coef f icie' t was .77 arid 
Kendall's Tau was .76. 

Looking at sites individually, the response rate ranges 
from 0 to 100% with 18 out of 23 sites above 83%. The 
reliability coefficients range from .20 to .98 with 14 out 
23 sites above -77. 

Father ' s Education : 

Across all sites, the response rate was 51.1% f^r the 
GIF vs. 89.5% for the PIF. This is a rather large differ- 
ential. Perfect agreement was 26%.^ The Pearson r was .77 
and Kendall's Tau was .67, 
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Looking at sites individually, the percent response 
ranges from 3% to 86% with 13 out of 23 sites below 52%. 
For this data, the agreement is fair but the response rate 
is poor. 

Mother ' s Occupatio n : 

Across al]. sites, the response rate was 83.2% for the 
CIF vs. 83.7% for the PIF. Of those missing a response 
on the PIF, 64% were coded (12 housewife) on the CIF. Of 
those missing data on the CIF, 66% were coded (15 unemployed) 
on the PIF. This may indicate a confusion in instructions in 
"the actual recording of the information. Perfect agreement was 
24%. The Pearson r was .59; Kendall's Tau was „51. 

Looking at sites individually, the percent response 
ranges from 40% to 97% with 14 out of 23 above 83%. Reliabili 
coefficients range from .03 to .83 with 10 of 23 above .60. 

In this situation the percent response is' perhaps ade- 
quate, but the agreement is not very good. 

Mother's Statu s: 

We have reason to believe that considerable confusion 
existed on the part of parents with regard to the "Status" 
questions which asked whether the respondant was employed full 
time, part-time or seasonally or unemployed. For exampjle, 
on Mother's Status the percent response was lower on the. PIF 
(76%) than on the CIF (92%). Looking at sites individually, 
it was not unusual to ..see a high response on occupation and 
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a low response on status. Percent perfect agreement was 54% 
which is low considering there are only 4 legitimate responses. 
Cramer's. V was .50 and Kendall's Tau was .48. 

Father's Occupation : 

Across all sites, the percent response on the CIF was 
58% vs. 65% on the PIP. It appears from the PIF information 
that parents are reluctant to give infomnation on Father's 
Occupation) either that or there was difficulty comprehend- 
ing the question. Out of the 384 lacking a response on 
the CIF, 234 also lack a response on the PIF. It is 
possible that some of these households had female heads 
since there was no specific identification of fatherless 
families. 

Perfect agreement was 60% The Pearson r was .53 and 
Kendall's Tau was .58. The relatively high percent agree- 
ment is due to the large percent (23%) missing a response on 
both PIF and the CIF. 

Looking at sites individually , the percent response' 
ranges from 34% to 86% with 10 of 23 above^58%. ^ 

Father's Stat us: 

This question has the same problem as Mother's Status. 
Response rates were 68% PIF vs. 61% CIF. Perfect agreement was 
63%, but 23% of this is in a double Non-Response. Cramer's 
V was •47, and Kendall's Tau was .47. 

Across sites individually^, the percent response ranged 
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from 34% to 84% with 11 of 23 above 61%. 



Persons Under 18 = Persons over 18 : 

Both of these questions enjoy a healthy response rate 
on the GIF: 98.7% Under 18; -^96.9% - Over 18. This 
response rate is uniform across sites. 



/ 

Persons Under 18 Persons Over 18 



% Perfect Agreement 
K<inda]l's Tau 
Kar.ge % Response 
Rari^e % /j^freement 



70% 
.80 

90-99%' 
40-85% 



,1^ 



64% 
.56 

80-98% 
35-80% 



J* 



There does appear to be one possible confusion on the 
question "Persons 18+ ove^-* in the House" . There is an 11% 
non-response on the PIF with 90% of this in classes (1) 
and (2) for the CIF. There may have been some confusion on 
the PIF as to whether parents were supposed to count them- 
selves in this category . Other than this , the results on 
the PIF ar6 lAuch like the results of the CIF. 
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Language Spoken in .t l ie Home : 

Across sites r the response rate is 99%, which is 
quite uniform. In general, there is very high perfect 
agreement (94%). This is because most families (94%) speak 
English in the home. In almost every case where Spanish was 
•spoken in the home, it was not recorded on the CIF. The 
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GIF missed 75% these eases.-- At *^one site which had a very 

large non-English speaking fin^'t^^ population^/ the 

^ peVcent perfect agreement was only 22%, 



/ 

/ 

/ 
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APPENDIX F 

Parent Information Form Test-retest Reliability Study 

A small test-retest reliability study of the Parent 
Information Form was done in Kansas City in the fall of 
1971. Eighteen mothers filled out the same form of the 
PIF about a month after they had first filled it out. 

The form of the PIF used in the fall of 19 71 was a 
shorter form than that used in other years. It contained 
forty items, most of which were demographic, ' The areas 
covered by the form are: 



1. 


Previous Head Start experience 






2. 


Sesame Street viewing 






3. 


Toys and materials in the:; home 






4. 


Reading in the home 






5. 


Parental aspirations and expectations 


for 


child 


6, 


Perinatal experiences 






7. 


Mother' s education / employment status 


and 


occupation 


8, 


Father ' s education , employmen*t status 


and 


occupation 


9, 


Number of people in the household 






10 • 


Language spoken in the home 






11 • 


Home items 







Table A shows the distributions of answers for all 
the questions which had only chree^ possible answers: yes, 
no and don't know. The number of qucs Lioiinaires for which 
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TABLE A 

DISTRIBUTION OF PARENT INrORJ-l?VTION FORM (PIF) 
ITEMS WITH ONLY THREE POSSIBLE RESPONSES FOR 
18 MOTHERS IN A TEST POTEST RELIABILITY STUDY 







both 
yes 


both 
no 


1 
1 


yes 
no 


% 

agree 


both 
blank 


one 
blank 


1. Pre-school 


3 


13 




2 


88.9 


0 


0 


2. Sesame Street 


5 


10 




2 


88. 2 


0 


1 


5, Toys 
















A. 


Blackboard 


7 


6 




1 


92.9 


0 


4 


B. 


Chalk ^ 


7 


4 




2 


84. 6 


0 


5 


C. 


Colored Paper 


10 


1 




2 


84. 6 


0 


5 


D. 


Scissors 


12 


0 




3 


80.0 


0 


3 


E. 


Crayons 


16 


0 




1 


94.1 


0 


1 


F. 


Color Books 


17 


0 




0 


100.0 


1 


0 


G. 


Paints 


5 


4 




3 


75.0 


2 


4 




Clay 


1 


8 




0 


100.0 


1 


8 


!• 


Other Art 


4 


3- 




1 


87.5 


3 


7 


J. 


Musical- Inst. 


6 


4 




3 


75.0 


2 


3 


K. 


Alphabet & 
Number Cards 


7 


5 




3 


80.0 


1 


2 


L. 


Games 


7 


3 




4 


71.4 


2 


2 


M. 


Puzzles 


8 


5 




0 


100.0 


2 


3 


N. 


Records 


8 






1 


91.7 


1 ■ 


5 


6 , Ever Read 


16 




• 

1 


94.1 


0 


1 


13. Born on Time 


13 


2 




2 


88.2 


0 


1 


14. More than month 
early 


0 


1 




1. 


50.0 


12 


4 


15. Birth 


1 


13 




3 


82.4 


0 


1 



Complications 



530 



TABLE A 



(con' t) 





both 
yes 


both 
no 


1 
1 


yes 
no 


% 

agree 


both 
blank 


one 
blank 


16. OK first week 


17 


0 




0 


100.0 


0 


1 


±y m wo uner going 
to school 


X 


xO 




1 

X 


Q A A 


A 
U 


u 


to school 


A 
U 


X 4 




1 

X 




1 
X 


0 


job 










D O . D 


u 


0 


for job 


n 


1 9 
x^ 






fto n 


n 




UIlCX. ilCtU jKJkJ 

during year 


4 
•* 


X X 






Rft 9 


n 

u 


1 
X 


30. Father paying 

JKJU 


13 


2 




0 


100.0 


3 


0 


oj. xauner xooKing 
for job 


1 
X 


7 9 
xZ 




X 




ft 


A 
U 


34. Father had job 
during year 


2 


10 




1 


92.3 


4 


1 




4 


1 2 




2 " 


ft ft Q 


n 


n 


















A. Auto 


14 


X 




1 


Q 0 Q 
^ J . O 


X 


X 


D. TV ^ 


i J 


1 




1 




X 




L-OxOr iV 


7 






U 


xu u . u 






D. Encyclopedia 


6 


5 




1 


91.7 


1 


5 


E. Dictionary 


13 


2 




1 


93.8 


0 


2 


F. Washer 


10 


5 




1 


93.8 


1 


1 


G. Vacuum Cleaner 


11 


5 




1 


94.1 


1 


0 


H. Record Player 


15 


1 




1 


94.1 


0 


1 


I. Telephone 


16 


1 




1 


94.4 


0 


0 
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the response was "yes" for both time 1 and time 2 is given 
in the first column; the number of both "no" responses in , 
the second, and so on. The percent agreement in the fourth 
column does not include blanks or don't knows^ it is equal 
to the sum of columns one and two divided by the sum of 
one, two and three. The percent agreement for those 
questions which have an adequate response rate is quite 
high. 

Table B shows the distribution of answers for ques-- 
tions which had more than three possible responses. 
Questions 10, 11 r 12 and 17 required the mother to write 
in an answer. The other questions were multiple-choice, 
with more than two categories. Question 10., which asked 
what the parent thought might prevent her child from 
getting the education he wanted, had both an adequate 
response and high (83%) agreement. Question 31, whether 
the father was working full or part-time, also had good 
agreement. Question 7, on how often the parent read to 
her child, had good response, but only moderate (62%) 
agreement. The other questions — on Sesame Street, birth 
weight, where the child and the motlier grew up — seem almost 
worthless. The low response rates on type of school attended 
and on mother's job status are obvioi^^^ly explained by the 
answers to questions 19, 22, 24 and 27. Almost no parent 
went to school; almost no mother worked. 

ERLC 
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TABLE B 

DISTRIBUTION OF PIF ITEMS WITH MORE THAN 
THREE POSSIBLE RESPONSES FOR 18 MOTHERS 
IN A TEST-RETEST PELIA3ILITY STUDY 



Same Different Both DK One 
Answer Answer or Blank Blank 



3. How often child 2 > 4 10 2 
watches Sesame St. 

4. How often watch 4 3 6 ' 5 
-with him 

7. How. often read 10 6 0 2 

10. Prevent schooling 15 3 0 • 0 

11. Where child grew 2 1 10 . 5 
up 

12. Birth weight 13 5 0 0 

17. Where mother grew 0 1 13 4 

up 

20. Mother kind of 1 0 16 1 

school 

23. Father kind of 0 0 17 1 

school 

25. Mother full/part 2-0 13 3 

time 

29. Mother why change 3 1 12 - .2 

jobs 

31. Father full/part 10 1*4 3 

time 

35. Father why change 2 0 15 1 

jobs 
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Table C shows the distribution of responses on ten, 
of the more important demographic variables. The questions 
on mother's and father's occupations had low response rates. 
It is difficult to judge the reliability of the responses. 
The data on the number of peopla in the home seems quite 
good. Discrepancies- in response to this question may , • 
of course, result from real changes in the composition 
of the household. The data on educational aspirations is 
moderately consistent (72%) as is the data on educational 
expectations (67% agreement). The data on mother's 
and father's education appears to be excellent. 

These findings indicate that the PIF is pr(pbably a 
reliable instrument for gathering demographic data of 
the sort elicited in the fall 1971 short form, especially 

when questions are asked in a simple yes/no format. 
Even this modest conclusion .Tiust be treated with some 
scepticism, however, since the reliability study sample- 
was so small. There is no information on the reliability 
of attitude and participation items of the sort used in 
other forms of the PIF, The findings on the moderate 
consistency of the educational aspirations and expecta- 
tions questions and on the low response rates for many 
questions make us somewhat dubious about the possibility 
of gathering good attitude data. 
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TABLE C 

DISTRIBUTION OF SELECTED PIF RESPONSES FOR 
18 MOTHERS IN A TEST-RETEST RELIABILITY STUDY 





ft. b P I 


{NATIONS 


p Y p T? 

£i A IT Hi 


r T T n 


N S 




Time 1 


Time 2 


# the 
Same 


Time 1 


Time 2 


# the 
S ame 


8 Educational 
Aspirations 


9 


0 


1 


0 


n 
u 




0 


9 Educational 


10 


0 


0 


0 


0 


0 


0 




11 


0 


0 


0 


0 


0 


0 




12 


1 


1 


1 


1 ' 


9 


8 




1 


0 


0 


0 


1 


0 


0 




2 


1 


1 


I 


0 


1 


0 




3 


0 


0 


0 


0 


0 


0 




4 


8 


7 


5 


5 


4 


3 




4-t 


8 


8 


6 


1 


2 


1 


Blank 


DK 















ERIC 



535 



TABLE C 



(con' t) 



18 Mother' s 
Education 



21 Father's 
Education 



rime 1 



M 0 T H "E R 
Time 2 



2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
1 
2 
3 
4 

Blank DK 



0 

0 

0 

0 

1 

1 

1 

0 

1 

1 

8 

3 

1 

0 

0 

1 

0 



0 
0 
0 
0 

1 
1 
1 

0 

1 
1 

8 
3 
1 
0 
0 
1 
0 



# the 
Same 



0 
0 

0 * 
0 

1 
1 
1 

0 

1 
1 

8 
3 
1 
0 
0 
1 
0 



FATHER 



Time 1 



0 

2 

0 

1 

0 

0 

1 

0 

2 

0 

6 

1 

2 

0 

0 

0 

3 



Time 2 



# the 
Same 



0 
2 
0 
1 
0 
0 

1 

0 

2 

0 

6 

0 

3 

0 

0 

0 

3 



0 

2 

0 

1 

0 

0 

1 

0 

2 

0 

6 

0 

2 

0 

0 

0 

3 
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TABLE C 



(con' t) 



MOT HE R 



F A T H E 



Time 1 



Time 2 



# the 
Same 



Time 1 



Time 2 



# the 
Same 



26 Mother' s- 
Occupation* 

32 Father's 
Occupation 



2 
3 
4 
5 
6 
7 
8 
9 
10 
11 
12 
13 
14 
15 
16 

Blank DK 



0 
0 
0 
0 
0 
0 
1 

0 

1 

0 
0 
0 
0 
0 
15 



0 
0 
0 
0 
0 
0 
3 
0 
0 
0 
0 
0 
0 
0 
0 
14 



0 
0 
0 
0 
0 
0 

1 

0 
0 
0 
0 
0 
0 
0 
0 
13 



0 
0 
0 

1 

2 
0 
3 
0 
0 
5 
0 
0 
0 
0 
0 
7 



0 
0 
0 
1 
3 
0 
3 
0 
1 
4 
0 
0 
0 
0 
0 
6 



0 
0 
0 
1 
2 
0 
3 
0 
0 
4 
0 
0 
0 
0 
0 
6 



Occupations were codes using adaptations of census categories. 
Category 1 includes professional and technical; category 11 includes 
laborers; 12 = housewife; 13 = disabled; 14 = student; 15 = unemployed, 
retired; 16 = no spouse. It should be noted that question 26 was 
only ansv/ered by those mothers who had a paying job. 
O 
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TABLE C 
(con't) 





;U N 


D 


E R 


1 


8 




0 


V E R 18 




Time 


1 


Time 


2 




ff tne 
Same 


Time 


1 


Time 2 


ff tne 
Same 


36 


# under 
18 


1 


1 




1 






1 


3 




3 


3 


37 


# over 
18 


2 


6 




7 






6 


12 




12 


11 






3 


2 




3 






2 


P 




1 


0 






4 


3 




2 






2 


1 




0 


0 






5 


3 




2 






2 


0 




0 


^ 0 






6 






1 






1 


0 




0 


0 






7 


d 




0 






0 


0 




0 


0 






8 


2 




1 






1 


0 




0 


0 






8+ 


0 




1 






0 


0 




0 


0 


\ 


Blank 


DK 


0 




0 






0 


2 




2 


1 



\ 

38 Language in home 



Both English ,..13 

Both Engl-^sh, also both Spanish 2 

Both English, Spanish once 2 

One Spanish, one English 1 



APPENDIX G 
Quality of the Testing Procedures 
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Testing procedures changed considerably during 
the ^three years of the HSPV evaluation, - as a result 
of changes in the test battery and improvements in ' / 
procedures. This section will describe training and 
monitoring procedures used in 1970-71 and 1971-72. 
It ^ill also report the findings of an independent 
monitoring procedure carried out in Spring 1972, which 
provides the best data we have on the quality of the 
testing procedures. 



Organization of Testing 

Testing in both years was done by local parapro- 
fessionals, under the supervision of a local site coor- 
dinator. The site, coordinator was selected by the 
Head Start director in each site, with the approva] of 
SRI. The site coordino^tcr , often in consultation with 
the Head Start director, hired a sufficient number of 
local testers to complete testing within the allotted 
three-'Week period. During 1970-71, at least one tester 
per site was a trained Binet tester. Testers in 1971- 
72 were not r3quir<=^d to have special qualifications. 



For a ir.ore extensive au.i^>cussion of testing procedures for all 
three ^jars of the HSPV 3tudy, see IiTiplementat/ on of Head Start 
Planned Variation Testing and Data Collection Effort , fonlo Park,- 
California: Stanford Rer^oarch Institute, 1972. 
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The tests were arranged into "batteries," each of 
which constituted a single testing session for a child. 
Each tester was trained* in one of the batterids . The 
organization of the batteries and, the number of testing 
personnel is shown below: 



1970-71, fall and spring 
^ Site coordinators 
Binet testers 
Auxiliary batcery testers 
NYU Booklets 
PSI - 

Motor Inhibition , 

EIQ, CCAS' (19 sites) 

Eight - Block observers 
(spring- oniy)^ 

Eight - Block trainer.s 
(spring only) 



41 
44 
68 



41 (approx.) 



41 (approx.) 



1971, fall 

Site coordinators 
Clerical assistants- 
Basic battery testers: 

PPVT 

PSI 

WRAT 



33 
84 
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Brown testers* 9 
Supplementary battery testers: 35 

Enumeration 

ITPA 

Motor Inhibition 
Eight - Block observei^s 39 
Eight - Block trainers 40 

1972, spring 

Site coordinators 35 
Clerical assistants 38 
Basic battery A testers: 85 

Gumpgoohies/ 

W^RAT 

Basic battery B testers 85 
PPVT 
PSI 

Enumeration 
5;upplenion tary battery testers 34 
Relevant Redundant Cues 
Motor Inhibition 
ITPA 



*In n";OSt sites Br^n testing was done by th4} supplementary 
battery tester or the basic battery tester/ 



ERLC 
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197)2, spring (con't) 

[ I 

i \ - 

Eight - Block observers 17 
Eight - Block trainers ; 17 

^Training & Monitoring 

^ ■ ' 1-3 , 

( 

1970 - 71 : All site coordinators were trained at SRI 
during one 4-day session in August. Training was 
conducted by SRI Pei'sonnel. Auxiliary battery testers 
were trained on site by the site coordinators, imme- 
diately preceding the beginning of testing. Binet testers 
were trained in the use of the Hertzig-Birch scoring 
and in HSPV evaluation procedures by SRI personnel in 
full-day sessions at two separate locations. Eight - 
Block observers were trained by SRI personnel in three 
locations. . Eight - Block observers trained Eight - 
Block trainers on site. Since the spring battery was 
the same as the fall, except for the Eight - Block sort, 
training of site coordinators was not repeated in the 
spring. Site coordinators apparently gave refresher 
training and training for new testers as needed. 

Fall 19 71 : Training procedures for fall 1971 were 
basically the same a*^ t^ose for 1970-71. Site coor- 
dinators were trained du\ing one 5-v^ay session at SRI. 
Site coordinators traineq basicbattery testers, 
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supplementary battery testers and Brown testers on site. 
Eight - Block observers were; traiiied in three groups 
by SRI Personnel during 3-day training sessions. Eight * 
Block observers trained Eight - Block trainers on site. 

Sprinc 19 72 : Additional training was given in spring 
1972, since new tests were added to the spring battery, 
and since special efforts were made to insure ."^at the 
last HSPV testing would be of Mg^ quality. Site coor- 
dinators were trained in two groups during five-day 
sessions at SRI. These longer sessions included practice 
testing of children and written tests on procedures. 
Site coordinators then trained basic battery, supplemen- 
tary battery and Brown testers. 

Monitoring : The procedures described above imply that 
training for most of the tests takes place on three 
levels : SRI personnel , site coordinators and local 
testers. The probability that procedural deviations 
will _occ_ur.._at. one point or other along the line is higher, 
therefore r than it would be if all testers were trained 
together. There is also a possibility that site 
biases might be introduced, since all testers at a site 
are trained by one person. Monitoring of testing is 
necessary to ensure that these potential biases are not 
introduced. D^uring 1970-71, SRI personnel visited the 
sites during the first two days of testing, to help 
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with final training and to check that standard testing 
procedures were boing used. During 19 71-72 independent 
observers as well as SRI personnel participated in 
monitoring testing. , Their spring reports provide the 
basis for the following discussion of testing quality. 

Independent Assessment of Testin g Qua 1 i ty; 

Five independent observers visited fifteen sites 
during spring 1972 testing. The five observers were 
hired by OCD, independent of SRI. All were specialists 
in both child development and testing. They were 
instructed to observe the actual testing situations^ 
placing themselves so that they could hear the tester 
and child and observe the tester's codings. They 
recorded a.l 1 instances of coaching^ piv^ccdual and 
coding errors which they observed. 

The numbers of testers and test administrations 
which were observed are: 

Te^t battery ~ ~ Num5er" of " testers Number of children 

Basic battery A 28 52 

Basic battery B 29 39 

Supplementary battery 11 20 

68 111 
The observers were asked to record their general 
impressions of site and tester biases, in addition to 
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recording specific errors. Their records give the 
impression that testing was generally of extremely 
high qualicy. 

Of thr. fifteen sites vi.sited, only three elicited 
negative general comments from the observers: 

Houston: "site supervisor seemed uncommitted to 

quality training and supervision" (.hut reports 

on testers were all good) . 
Greeley: "a few of the testers acted overtly 

hostilo to minority children."' 
Des Moines: "more little -errors in most of the 

testers than in {other sites which the observer 

visited) . . . the lack of what really constitutes 

an acceptable probe is certainly a site bias here." 
Al] other site comments were positive. For example: 
Fort Walton: "testers are well trained and have 

good rapport techniques. Generally . . • data 

will be all valid. " 
Loch Haven: "the testers seemed excellently 

prepai a . " 

Jonesboro: "all the testers demonstrated the same 

high attention to detail that is so crucial to 

getting good data." . 
Bellows Falls: "the testers were ver^ capable . . . 

all testers seemed to have a good grasp of what 

they were doing." 

ERIC 
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The observers reccxded gemeral negative cornments 

about only eight of the sixty-eight testers whom they 
1 

observed. These eight were the only testers^ who the 
observers felt might be eliciting a biased or invalid 
test score. All other testers were considered to be 
well within acceptabTe~~rimits . Many received rave 
reviews. 

The observers c Vvere instructed to record each error 
thny observed in test administration. This is a 
demanding instruction^ and some of the: observers were 
more perfectionist than others. Nonetheless^ their 
reports indicfite that they did record every error 
which seemed important. (Unimport^ant errors were less 
consistently reported. One observer^ for example^ 
recor.ded a procedural error when the PSI checkers were 
not precisely spaced. Others did not seem to be quite 

this precise) . 

Table 1 shows the frequencies of recorded errors, by 
test and type of error (coaching, procedural, coding, timin 



Their comments were 
— "very directive and brusque .. .depressed children's scores. 
— "messed up on scoring the PSI... a lot of probing." 
— "upon first observation is an inadequate tester .. .quite 

unclear about when to repeat items and when or how to 

prompt ..." 

— "seems on the hostile side and makes almost no attempt 

to be pleasant." 
— "horrible testing conditions ... like a goddamne'd zoo." 
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TABLE 1 

FREQU ENCY OF RECORDED 'I RR ORS, BY TEST AND 
TYPE OF ERROR, MADE B^'FIVE INDEPENDENT 
OBSERVERS ABOUT SPRING 19 72 DATA COLLECTION 



PPVT (39) 

PSI (39) 

Enumeration 
(39) 

Gunipgoohies 
(52) 

WRAT (52) 

RRC (20) 

MI (20) 

ITPA (20) 



Pro- 
Coaching Gedural 



1 
4 



0 
1 
0 
0 
1 



0 
18 



1 
9 
2 
0 
1 



C oding 
3 
16 



0 
8 
1 
0 

,3 



Timing Start Stop 



■'"Number of observed test administrations is in parentheses. 
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A coaching error would be a verbal or noH'-verbal cue given 
by the tester to the child to indicate his; response was 
satisfactory or not (i.e., allowing a chi'id a second chance 
on an item, consistently smiling at a child's correct recj- 
ponses, etc.) A procedural error would be a deviation from 
instructions for the test (i.e. , pointing to a correct 
gumpgookie when .-eading a response, starting incorrectly on 
the PPVT, proceeding to the test without giving the adequate 
pretest tasks on the MI, etc.) A coding error would be a 
mistake made in recording the child's response (i.e., not 
circling "V" for a verbal response on the PSI, etc.) A 
-timing error would be a mistake in recording the start or 
finish of a test or an error in time given for some specifi- 
cally timed items, such as those on the VJRAT. The number of 
errors recorded is probably larger than they would be if the 
observers had been instructed to consistently record "iirpor- 
tant errors*' They are smaller than if each observer had 
recorded tiny procedural deviations.) 

Errors were recorded by /it^.-^ Considering the large 
number of items on the various tests, the number of errors 



is q\iit^--Iow. On only two tests, (Enumeration and the PSI) 
^t5es^ the total number of errors average more than .5 per test. 
t^any of the errors- would not be e:cpected to influence a 
student's score at all. No systematic baisss were in evidence. 
All in all, we can be quite confident that the general level 
of testing competence in spring 1972 was high. 
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